-- Logs begin at Fri 2022-08-26 14:52:58 UTC, end at Fri 2022-08-26 15:55:07 UTC. -- Aug 26 15:25:26.556765 dv-cinder-831247-24-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 26 15:25:26.566155 dv-cinder-831247-24-smb devstack@keystone.service[81756]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 15:25:26 2022] *** Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: nodename: dv-cinder-831247-24-smb Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: machine: x86_64 Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: clock source: unix Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: pcre jit disabled Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: detected number of CPU cores: 4 Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: current working directory: / Aug 26 15:25:26.567439 dv-cinder-831247-24-smb devstack@keystone.service[81756]: detected binary path: /usr/bin/uwsgi-core Aug 26 15:25:26.567984 dv-cinder-831247-24-smb devstack@keystone.service[81756]: your processes number limit is 47680 Aug 26 15:25:26.567984 dv-cinder-831247-24-smb devstack@keystone.service[81756]: your memory page size is 4096 bytes Aug 26 15:25:26.567984 dv-cinder-831247-24-smb devstack@keystone.service[81756]: detected max file descriptor number: 2048 Aug 26 15:25:26.567984 dv-cinder-831247-24-smb devstack@keystone.service[81756]: lock engine: pthread robust mutexes Aug 26 15:25:26.567984 dv-cinder-831247-24-smb devstack@keystone.service[81756]: thunder lock: enabled Aug 26 15:25:26.567984 dv-cinder-831247-24-smb devstack@keystone.service[81756]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 26 15:25:26.567984 dv-cinder-831247-24-smb devstack@keystone.service[81756]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 15:25:26.607780 dv-cinder-831247-24-smb devstack@keystone.service[81756]: Python main interpreter initialized at 0x562c129bd9c0 Aug 26 15:25:26.607780 dv-cinder-831247-24-smb devstack@keystone.service[81756]: python threads support enabled Aug 26 15:25:26.607780 dv-cinder-831247-24-smb devstack@keystone.service[81756]: your server socket listen backlog is limited to 100 connections Aug 26 15:25:26.607780 dv-cinder-831247-24-smb devstack@keystone.service[81756]: your mercy for graceful operations on workers is 90 seconds Aug 26 15:25:26.608182 dv-cinder-831247-24-smb devstack@keystone.service[81756]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 15:25:26.608261 dv-cinder-831247-24-smb devstack@keystone.service[81756]: *** Operational MODE: preforking *** Aug 26 15:25:26.608487 dv-cinder-831247-24-smb devstack@keystone.service[81756]: *** uWSGI is running in multiple interpreter mode *** Aug 26 15:25:26.608487 dv-cinder-831247-24-smb devstack@keystone.service[81756]: spawned uWSGI master process (pid: 81756) Aug 26 15:25:26.608697 dv-cinder-831247-24-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 26 15:25:26.609705 dv-cinder-831247-24-smb devstack@keystone.service[81756]: spawned uWSGI worker 1 (pid: 81766, cores: 1) Aug 26 15:25:26.609705 dv-cinder-831247-24-smb devstack@keystone.service[81756]: spawned uWSGI worker 2 (pid: 81767, cores: 1) Aug 26 15:25:26.609839 dv-cinder-831247-24-smb devstack@keystone.service[81756]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 15:25:30.907782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:25:30.907782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: from cryptography.utils import int_from_bytes Aug 26 15:25:30.908548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:25:30.908548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: from cryptography.utils import int_from_bytes Aug 26 15:25:30.908662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:25:30.908662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: from cryptography.utils import int_from_bytes Aug 26 15:25:30.908662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 15:25:30.908662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: from cryptography.utils import int_from_bytes Aug 26 15:25:30.958670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:25:30.958865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:25:30.959594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] command line args: [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:25:30.959702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 15:25:30.959870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:25:30.959956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 15:25:30.960035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ================================================================================ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:25:30.960110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] command line args: [] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 15:25:30.960296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] admin_token = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.960374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 15:25:30.960503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ================================================================================ {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 15:25:30.960587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config_dir = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.960719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.960801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] admin_token = **** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.960903 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] config_source = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.960986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] config_dir = [] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.961085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] debug = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.961170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.961285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.961534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] config_source = [] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.961534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] debug = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.961640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.961706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.961864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.961963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.962073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.962173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.962316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.962424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.962550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.962664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.962765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_config_append = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.962864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] list_limit = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] log_config_append = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_dir = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] log_dir = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] log_file = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.963930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.964982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.965094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.965218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.965303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.965453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.965531 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.965687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.965768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.965922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.966049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.966163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.966239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.966409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.966487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.966658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.966783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.966956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.967210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.967396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] publish_errors = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.967482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.967630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.967706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] publish_errors = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.967863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.967946 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.968044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.968120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.968274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.968347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.968519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.968605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.968755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] standard_threads = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.968837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.968989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] standard_threads = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969297 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_journal = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_json = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] use_journal = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_stderr = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.969981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] use_json = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.970087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] use_syslog = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.970174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] use_stderr = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.970314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] use_syslog = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.970387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.970549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 15:25:30.970631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.970799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.970881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.971069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.971146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.971335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.971411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.971581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.971664 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.971836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.971911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.972078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.972152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.972321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.972402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.972561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.972635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.972808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.972882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.973060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.973142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.973295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.973370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.973543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.973620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.973781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.973866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.974021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.974095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.974266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.974347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.974503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.974587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.975349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.975452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.975599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.975677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.975849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.976005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.976077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.976145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.976333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.976408 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.976595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.976673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.976849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.976922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.977100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.977176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.977336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.977413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.977571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.977646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.977803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.977879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.978038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.978113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.978284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.978365 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.978530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.978611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.978764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.978841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.979016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.979097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.979265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.979340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.979510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.979592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.979750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.979825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.979991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.980065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.980223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.980306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.980459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.980542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.980694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.980771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.980926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.981003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.981159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.981235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.981392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.981473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.981615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.981687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.981852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.981926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.982096 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.982174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.982335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.982411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.982575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.982651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.982807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.982883 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.983068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.983145 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.983306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.983381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.983547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.983620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.983778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.983860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.984017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.984093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.984258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.984333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.984627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.984712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.984779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.984869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.984958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.985035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.985190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.985258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.985427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.985502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.985726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.985868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.986001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.986123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.986240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.986371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.986371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.986607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.986607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.986867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.987023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.987155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.987275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.987400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.987520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.987665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.987786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.987906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.988026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.988156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.988277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.988403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.988536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.988652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.988778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.988898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.989025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.989151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.989272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.989398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.989522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.989648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.989769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.989896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.990017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.990137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.990276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.990398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.990522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.990657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.990778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.990902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.991055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.991188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.991312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.991443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.991569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.991694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.991817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.991940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.992063 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.992196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.992320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.992443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.992566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.992691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.992820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.992955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.993080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.993203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.993326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.993449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.993577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.993778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.993910 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.994034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.994154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.994278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.994410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.994541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.994680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.994807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.994944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.995066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.995190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.995313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.995444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.995569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.995692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.995817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.995941 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.996064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.996194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.996318 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.996456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.996580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.996703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.996827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.996967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.997090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.997213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.997342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.997485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.997619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.997773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.external = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.997906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.998039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.998174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] auth.external = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.998299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.998424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.998554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.998704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.998837 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.password = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.999014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.999137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] auth.token = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.999261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] auth.password = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.999385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.999508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] auth.token = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.999646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.999770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:30.999893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.000028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.000161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.000285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.000416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.000535 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.000663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.000663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.000896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.001021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.001154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.001278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.001401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.001544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.001677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] credential.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.001801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.001933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.002067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.002201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.002326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.002451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.002575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.002706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.002831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.002968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.003097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.003219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.003344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.003485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.003617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.003742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.003742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.003976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.004101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.004231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.004231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.004459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.004580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.004700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.004820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.004949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.005125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.005256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.005378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.005498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.005618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.005747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] federation.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.005868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.005987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.006107 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.006229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.006353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.006482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.006604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.006725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.006855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.007054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.007185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.007312 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.007438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.007563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.007684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.007811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.007943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.008069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.008194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.008323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.008449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.008583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.008794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.008917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.009042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.009167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.009292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.009416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.009553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.009678 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.009802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.009925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.010049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.010173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.010308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.010444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.010570 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.010694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.010818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.010959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.011091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.011216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.011341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.011466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.011591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.011715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.011847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.011972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.012100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.012228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.012354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.012480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.012612 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.012738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.012862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.012987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.013112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.013236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.013369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.013494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.013618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.013744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.013878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.013878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.014120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.014120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.014343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.014465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.014585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.014706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.014833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.014984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.015106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.015230 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.015356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.015480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.015627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.015753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.015878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.016002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.016125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.016249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.016382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.016506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.016630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.016754 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.016879 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.016879 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.017120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.017120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.017377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.017501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.017625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.017762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.017890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.017890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.018123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.018247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.018371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.018503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.018627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.018752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.018876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.019037 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.019159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.019550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.019672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.019795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.019922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.020043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.020163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.020291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.020412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.020532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.020653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.020774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.020894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.021031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.021153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.021274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.021394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.022002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.022133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.022261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.022382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.022502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.022623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.022743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.022863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.023047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.023179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.023306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.023429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.023558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.023682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.023813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.023935 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.024059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.024059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.024317 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.024439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.024571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.024696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.024820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.024953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.025078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.025078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.025322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.025446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.025570 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.025693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.025817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.025941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.026075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.026201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.026326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.026449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.026583 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.026707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.026839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.026839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.027081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.027203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.027325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.027444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.027536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.027700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.027820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.027940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.028066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.028188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.028325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.028447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.028567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.028692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.028813 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.028934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.029061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.029182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.029301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.029423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.029542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.029661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.029789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.029909 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.030038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.030159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.030279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.030399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.030530 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.030652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.030772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.030891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.031080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.031205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.031337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.031463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.031586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.031709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.031843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.031968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.032104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] resource.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.032228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.032352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.032475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.032600 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.032724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.032856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.032980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.033104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.033228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.033352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.033565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.033693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.033817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.033941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.034065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.034189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.034321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.034444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.034568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.034694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] role.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.034818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.034955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] role.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.035087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.035209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.035341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.035463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.035580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.035707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.035837 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.035959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.036079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.036200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.036322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.036442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.036571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.036693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.036814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.036945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.037067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.037222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.037850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.037974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.037974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.038202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.038324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.038445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.038573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.038695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.038818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.039022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.039022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.039261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.039393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.039514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.039634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.039755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.039877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.040008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.040130 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.040249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.040446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.040565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.040686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.040824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.040948 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.041068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.041189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.041309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.041429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.041557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.041678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.041798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.041919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.042040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.042166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.042293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.042414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.042544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.042665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.042665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.042891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.043062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.043187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.043311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.043435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.043435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.043622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.043749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.043873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.043998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] token.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.044133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.044258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.044380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.044510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.044636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.044760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.044883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.045006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.045132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.045264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.045386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.045510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.045634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.045634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.045877 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.046010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.046137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.046137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.046371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.046494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.046619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.046755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.046898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.047036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.047159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.047282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.047402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.047522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.047664 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.047786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.047924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.048053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.048175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.048175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.048404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.048526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.048655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.connection = **** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.048819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.048947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.049069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.049191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.049312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.049452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.049575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.049696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.049825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.049958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.050078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.050208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.050331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.050452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.050573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.050694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.050822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.051017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.051149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.051276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.051401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.051525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.051646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.051782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.051908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.052032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.052160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:25:31.052280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.052280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.052280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.052280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.052280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 15:25:31.052280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 15:25:31.077799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.078086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.078242 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.078557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.078798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.079053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.087761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.088395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.117305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.117571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.117702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.117826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.172240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.172658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.221806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.222067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.222633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.222881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.380474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.380720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.381377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.381514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.381660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.381788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.381911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.382034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.382157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.382288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.382412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.382412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.405509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.405771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.405860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.405959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.406039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.406167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.406252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.406384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.406476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.406602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.406685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.406819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.406903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.407067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.418668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.419196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.432058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.432291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.432516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.432617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.432739 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.432824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.432957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.433040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.433172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.433257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.433388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81766) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.433472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.433646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.433867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81767) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 15:25:31.450045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.450259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 15:25:31.450568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.450653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.450784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 15:25:31.450883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 15:25:31.451101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.451185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.451354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 15:25:31.451436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.451636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.451871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.451956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.452136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.452421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.452690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.461529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.461811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.462087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.462169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.462371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.462466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.462651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.462963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.469335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.469946 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.472268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.472562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.472850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.472931 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.473137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.473220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.473426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.473509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.473696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.473779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.473973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.474065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.474245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.474325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.475036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.475166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.475351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.475456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.475733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.475815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.476016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.476294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.498761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.499554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.500265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.500555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.501030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.501323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.505253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.505545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.505858 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.506076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.506370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.506660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.512244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.512536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.513066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.513361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.516661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.516959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.517250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.517487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.517568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.517805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.517887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.518087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.518300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.518385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.518627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.518765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.519556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.520198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.520700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.521177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.536908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.537765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.541819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.543744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.544053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.545075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.545377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.547957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.549593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.551212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.551523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.552834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.556227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.556545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.556847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.557181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.557466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.557764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.558286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.561727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.567251 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.568012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.569019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.569549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.569858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.570366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.574595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.574904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.575209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.575511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.582383 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.584526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.584806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.587525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.587817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.588125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.588423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.588718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.593198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.593518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.593815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.594091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.601754 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.601913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.602106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.602394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.602683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.603000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.603286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.603366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.603582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.603670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.606278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.606574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.606882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.607203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.607506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.619123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.619275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.619542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.619834 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.620127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.620427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.620833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.621139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.622066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.625019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.626458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.627979 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.628263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.628550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.635142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.636572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.636660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.639482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.639661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.639779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.640069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.640351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.642569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.644048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.645818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.646108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.646399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.649088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.649386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.649673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.653433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.654913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.656573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81766) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.656865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.657152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.657437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.657727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.657814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.658015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.658097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.658294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.658376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.658567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.658651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.658864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.659174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.659454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.659725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.660004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.660269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81766) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.667187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.667490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.667779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.674680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81767) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 15:25:31.674993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.675291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.675576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.675859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.676141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.676433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.676715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.677009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.677295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.677573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.677867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.678149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.678416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81767) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 15:25:31.695040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c129bd9c0 pid: 81766 (default app) Aug 26 15:25:31.698568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3edb97-6929-4c69-ba0e-4072a80b39b9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:31.698859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3edb97-6929-4c69-ba0e-4072a80b39b9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:31.699160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3edb97-6929-4c69-ba0e-4072a80b39b9 None None] PATH_INFO: `/v3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:31.703336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1/1] 10.222.0.89 () {50 vars in 791 bytes} [Fri Aug 26 15:25:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:31.713303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562c129bd9c0 pid: 81767 (default app) Aug 26 15:25:38.289583 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ba38-511a-45de-abbf-f37514cde8e2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:38.290101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ba38-511a-45de-abbf-f37514cde8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:38.290188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ba38-511a-45de-abbf-f37514cde8e2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:38.291493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 2/2] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:25:38.299735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:38.300222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:38.300299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:38.371843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: INFO dbcounter [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] Registered counter for database keystone Aug 26 15:25:38.391107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG oslo_db.sqlalchemy.engines [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:25:38.400369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writer thread running {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:25:38.582481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG passlib.handlers.bcrypt [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81767) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 15:25:38.582832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG passlib.handlers.bcrypt [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81767) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 15:25:38.638336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:38.639998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:38.766605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1/3] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 26 15:25:39.195885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ba38-511a-45de-abbf-f37514cde8e2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:39.264588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: INFO dbcounter [None req-2d23ba38-511a-45de-abbf-f37514cde8e2 None None] Registered counter for database keystone Aug 26 15:25:39.287299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG oslo_db.sqlalchemy.engines [None req-2d23ba38-511a-45de-abbf-f37514cde8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 15:25:39.293485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writer thread running {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 15:25:39.411888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ba38-511a-45de-abbf-f37514cde8e2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:39.416313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df2e3d-38e8-42db-974f-5793b1dfbd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:39.416956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df2e3d-38e8-42db-974f-5793b1dfbd69 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:39.417249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df2e3d-38e8-42db-974f-5793b1dfbd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:39.417523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df2e3d-38e8-42db-974f-5793b1dfbd69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:39.426184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df2e3d-38e8-42db-974f-5793b1dfbd69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:39.477597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e4df2e3d-38e8-42db-974f-5793b1dfbd69 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 15:25:39.477884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df2e3d-38e8-42db-974f-5793b1dfbd69 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:39.487957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 3/4] 10.222.0.89 () {58 vars in 1324 bytes} [Fri Aug 26 15:25:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:25:39.494514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:39.509104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd393ea1-f741-41f0-a2f9-788775bdbb43 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:39.513571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a2815-8681-4990-bc87-8d13bbdaa2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:39.514680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2815-8681-4990-bc87-8d13bbdaa2ce admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:39.514993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2815-8681-4990-bc87-8d13bbdaa2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:39.515285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2815-8681-4990-bc87-8d13bbdaa2ce admin admin] PATH_INFO: `/v3/projects/f82c5c1108704750815ed9407c515587` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:39.516859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a2815-8681-4990-bc87-8d13bbdaa2ce admin admin] RBAC: Authorizing `identity:get_project(project_id=f82c5c1108704750815ed9407c515587)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:39.569717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: WARNING keystone.common.rbac_enforcer.enforcer [None req-623a2815-8681-4990-bc87-8d13bbdaa2ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 15:25:39.570064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a2815-8681-4990-bc87-8d13bbdaa2ce admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:39.574647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 2/5] 10.222.0.89 () {56 vars in 1207 bytes} [Fri Aug 26 15:25:39 2022] GET /identity/v3/projects/f82c5c1108704750815ed9407c515587 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:41.475772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bb5d5-6aba-4eaf-a792-d0471a9b22d1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:41.476278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bb5d5-6aba-4eaf-a792-d0471a9b22d1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:41.476363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bb5d5-6aba-4eaf-a792-d0471a9b22d1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:41.480404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 4/6] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:41.485917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49540325-4908-41ae-bfec-998499d42d2e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:41.486373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49540325-4908-41ae-bfec-998499d42d2e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:41.486460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49540325-4908-41ae-bfec-998499d42d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:41.506123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-49540325-4908-41ae-bfec-998499d42d2e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:41.507667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-49540325-4908-41ae-bfec-998499d42d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:41.515429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 3/7] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 15:25:41.783162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bb5d5-6aba-4eaf-a792-d0471a9b22d1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:41.796506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bb5d5-6aba-4eaf-a792-d0471a9b22d1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:41.801425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd5ae1-5c81-4aff-ae64-d899d08d8ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:41.802678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5ae1-5c81-4aff-ae64-d899d08d8ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:41.802980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5ae1-5c81-4aff-ae64-d899d08d8ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:41.803252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd5ae1-5c81-4aff-ae64-d899d08d8ffc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:41.811438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd5ae1-5c81-4aff-ae64-d899d08d8ffc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:41.813190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd5ae1-5c81-4aff-ae64-d899d08d8ffc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:41.821915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 5/8] 10.222.0.89 () {58 vars in 1324 bytes} [Fri Aug 26 15:25:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:25:41.827816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49540325-4908-41ae-bfec-998499d42d2e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:41.836892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49540325-4908-41ae-bfec-998499d42d2e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:41.841220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612991f-1f2d-45b9-b049-98b6ae63ec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:41.841842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612991f-1f2d-45b9-b049-98b6ae63ec12 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:41.842121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612991f-1f2d-45b9-b049-98b6ae63ec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:41.842396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612991f-1f2d-45b9-b049-98b6ae63ec12 admin admin] PATH_INFO: `/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:41.843759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612991f-1f2d-45b9-b049-98b6ae63ec12 admin admin] RBAC: Authorizing `identity:get_user(user_id=6a0674a0b804427ca12cbbcd5e4a20f5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:41.845583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612991f-1f2d-45b9-b049-98b6ae63ec12 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:41.847134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 4/9] 10.222.0.89 () {56 vars in 1198 bytes} [Fri Aug 26 15:25:41 2022] GET /identity/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:43.799616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144be81-b6ee-4071-8c29-809080381ed6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:43.799994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144be81-b6ee-4071-8c29-809080381ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:43.800173 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144be81-b6ee-4071-8c29-809080381ed6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:43.801510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 6/10] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:43.807621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f2156-f411-40d5-952a-b04d30628109 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:43.808042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f2156-f411-40d5-952a-b04d30628109 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:43.808186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f2156-f411-40d5-952a-b04d30628109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:43.826542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ab1f2156-f411-40d5-952a-b04d30628109 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:43.827779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ab1f2156-f411-40d5-952a-b04d30628109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:43.844802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1957d06-4590-4ed7-a191-2385a9ad2c25 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:43.845089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1957d06-4590-4ed7-a191-2385a9ad2c25 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:43.845370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1957d06-4590-4ed7-a191-2385a9ad2c25 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:43.846693 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 7/11] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:25:43.851819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433c8ba-e075-4661-b536-73bf61e3a986 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:43.852104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433c8ba-e075-4661-b536-73bf61e3a986 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:43.852382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433c8ba-e075-4661-b536-73bf61e3a986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:43.894422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG passlib.handlers.bcrypt [None req-6433c8ba-e075-4661-b536-73bf61e3a986 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81766) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 15:25:43.894853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG passlib.handlers.bcrypt [None req-6433c8ba-e075-4661-b536-73bf61e3a986 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81766) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 15:25:43.909992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 5/12] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:43.940393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6433c8ba-e075-4661-b536-73bf61e3a986 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:43.941984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6433c8ba-e075-4661-b536-73bf61e3a986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:44.043101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 8/13] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:25:44.180684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f2156-f411-40d5-952a-b04d30628109 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.204665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:44.285434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f2156-f411-40d5-952a-b04d30628109 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:44.319250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0271-994a-4bd0-8bc6-679e1587b06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:44.319898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0271-994a-4bd0-8bc6-679e1587b06a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.320184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0271-994a-4bd0-8bc6-679e1587b06a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.320463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0271-994a-4bd0-8bc6-679e1587b06a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.324088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433c8ba-e075-4661-b536-73bf61e3a986 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.332342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0271-994a-4bd0-8bc6-679e1587b06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-7a7b0271-994a-4bd0-8bc6-679e1587b06a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:44.341782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:44.342845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:25:44.343822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 6/14] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:44.349252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0271-994a-4bd0-8bc6-679e1587b06a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.427546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433c8ba-e075-4661-b536-73bf61e3a986 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:44.429799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:44.431922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:44.451341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0271-994a-4bd0-8bc6-679e1587b06a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:44.465262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c71bd8-071a-48d8-949c-635361b03505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:44.466129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c71bd8-071a-48d8-949c-635361b03505 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.466415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c71bd8-071a-48d8-949c-635361b03505 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.466687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c71bd8-071a-48d8-949c-635361b03505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.484807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abc4cf-64dd-4232-b9ba-803b14b3a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:44.485423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abc4cf-64dd-4232-b9ba-803b14b3a617 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.485707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abc4cf-64dd-4232-b9ba-803b14b3a617 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.485984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abc4cf-64dd-4232-b9ba-803b14b3a617 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.486683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abc4cf-64dd-4232-b9ba-803b14b3a617 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:44.487002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abc4cf-64dd-4232-b9ba-803b14b3a617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:44.488416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abc4cf-64dd-4232-b9ba-803b14b3a617 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:44.501022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 7/15] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:44.507173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abc4cf-64dd-4232-b9ba-803b14b3a617 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.534045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c71bd8-071a-48d8-949c-635361b03505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:44.535645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c71bd8-071a-48d8-949c-635361b03505 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:44.607547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abc4cf-64dd-4232-b9ba-803b14b3a617 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:44.639193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 9/16] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:25:44.643809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bbc6d-0f7c-4797-90a2-9e18cbd7ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:44.644433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bbc6d-0f7c-4797-90a2-9e18cbd7ab7b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.644715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bbc6d-0f7c-4797-90a2-9e18cbd7ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.644993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bbc6d-0f7c-4797-90a2-9e18cbd7ab7b None admin] PATH_INFO: `/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.645179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c71bd8-071a-48d8-949c-635361b03505 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.646154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bbc6d-0f7c-4797-90a2-9e18cbd7ab7b None admin] RBAC: Authorizing `identity:get_user(user_id=6a0674a0b804427ca12cbbcd5e4a20f5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:44.647652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5bbc6d-0f7c-4797-90a2-9e18cbd7ab7b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:44.647941 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:44.649236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 8/17] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:44.655765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bbc6d-0f7c-4797-90a2-9e18cbd7ab7b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.670503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:44.745490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c71bd8-071a-48d8-949c-635361b03505 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:44.755614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bbc6d-0f7c-4797-90a2-9e18cbd7ab7b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:44.779451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050a290-1801-41d5-8f5b-5f03eb52d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:44.780708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050a290-1801-41d5-8f5b-5f03eb52d965 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.780989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050a290-1801-41d5-8f5b-5f03eb52d965 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.781265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050a290-1801-41d5-8f5b-5f03eb52d965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.791518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affa984-09c1-4df5-81fe-270535aa1bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:44.792159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affa984-09c1-4df5-81fe-270535aa1bac None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.792446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affa984-09c1-4df5-81fe-270535aa1bac None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.792719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affa984-09c1-4df5-81fe-270535aa1bac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.793843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affa984-09c1-4df5-81fe-270535aa1bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:44.795325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affa984-09c1-4df5-81fe-270535aa1bac None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:44.797111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 9/18] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:44.802280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050a290-1801-41d5-8f5b-5f03eb52d965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:44.802844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affa984-09c1-4df5-81fe-270535aa1bac None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.803782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050a290-1801-41d5-8f5b-5f03eb52d965 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1050a290-1801-41d5-8f5b-5f03eb52d965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:25:44.822963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:44.823971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:25:44.824764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:25:44.824764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:25:44.824764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:25:44.824764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 10/19] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:25:44.830905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050a290-1801-41d5-8f5b-5f03eb52d965 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:44.883520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:44.887202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:44.903955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affa984-09c1-4df5-81fe-270535aa1bac None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:44.936448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050a290-1801-41d5-8f5b-5f03eb52d965 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:44.938165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43802712-43ba-4c7e-94d5-140b05926f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:44.938779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43802712-43ba-4c7e-94d5-140b05926f32 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.939101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43802712-43ba-4c7e-94d5-140b05926f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.939387 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43802712-43ba-4c7e-94d5-140b05926f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.940119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43802712-43ba-4c7e-94d5-140b05926f32 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.domain.id=default, user.id=6a0674a0b804427ca12cbbcd5e4a20f5) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:44.940433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43802712-43ba-4c7e-94d5-140b05926f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:44.941885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43802712-43ba-4c7e-94d5-140b05926f32 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:44.948651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 10/20] 10.222.0.89 () {56 vars in 1322 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/role_assignments?user.id=6a0674a0b804427ca12cbbcd5e4a20f5&scope.domain.id=default&role.id=609b1a993a394f0e900e17edccebaea5 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:44.971841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed96fa-3fee-4a15-87b1-0be5e287432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:44.972475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed96fa-3fee-4a15-87b1-0be5e287432c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:44.972752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed96fa-3fee-4a15-87b1-0be5e287432c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:44.973022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed96fa-3fee-4a15-87b1-0be5e287432c None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:44.974217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed96fa-3fee-4a15-87b1-0be5e287432c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:44.974521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed96fa-3fee-4a15-87b1-0be5e287432c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:44.976018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed96fa-3fee-4a15-87b1-0be5e287432c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:45.004968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 11/21] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:47.018010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea21ed6-9536-49e2-8ba0-ad3c53c838a9 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.019159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea21ed6-9536-49e2-8ba0-ad3c53c838a9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.019608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea21ed6-9536-49e2-8ba0-ad3c53c838a9 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.021427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 11/22] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:47.032643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a90c0-6a3a-43e8-96b4-2159fbb4f5e8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.033472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a90c0-6a3a-43e8-96b4-2159fbb4f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.033907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a90c0-6a3a-43e8-96b4-2159fbb4f5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.064061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a34a90c0-6a3a-43e8-96b4-2159fbb4f5e8 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:47.065484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a34a90c0-6a3a-43e8-96b4-2159fbb4f5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:47.147584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 12/23] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:47.193861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55bfa3-ba17-40e3-ae1f-d8d1d3dad03a None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.194398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55bfa3-ba17-40e3-ae1f-d8d1d3dad03a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.194849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55bfa3-ba17-40e3-ae1f-d8d1d3dad03a None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.196610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 12/24] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:47.212515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efb902-da52-4c96-8db3-7c1243f23011 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.213020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efb902-da52-4c96-8db3-7c1243f23011 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.213455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efb902-da52-4c96-8db3-7c1243f23011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.243966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b8efb902-da52-4c96-8db3-7c1243f23011 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:47.245436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b8efb902-da52-4c96-8db3-7c1243f23011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:47.297994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:47.334877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 13/25] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:47.566780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55bfa3-ba17-40e3-ae1f-d8d1d3dad03a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:47.581962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d95a5-837e-4c10-8ecd-f8e759bc455d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.582506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d95a5-837e-4c10-8ecd-f8e759bc455d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.583502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d95a5-837e-4c10-8ecd-f8e759bc455d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.585049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 14/26] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:47.592504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc682d-9392-4dea-9a07-9cb17aeb4c4f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.593903 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc682d-9392-4dea-9a07-9cb17aeb4c4f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.594510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc682d-9392-4dea-9a07-9cb17aeb4c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.633216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-10bc682d-9392-4dea-9a07-9cb17aeb4c4f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:47.634417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-10bc682d-9392-4dea-9a07-9cb17aeb4c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:47.774924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 15/27] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:47.775700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc682d-9392-4dea-9a07-9cb17aeb4c4f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:47.838088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55bfa3-ba17-40e3-ae1f-d8d1d3dad03a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:47.967902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc73530-6d4d-4f96-8541-987e701ce9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:47.968561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc73530-6d4d-4f96-8541-987e701ce9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:47.968848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc73530-6d4d-4f96-8541-987e701ce9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:47.969128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc73530-6d4d-4f96-8541-987e701ce9d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:47.979308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc682d-9392-4dea-9a07-9cb17aeb4c4f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:47.987407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.011699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc73530-6d4d-4f96-8541-987e701ce9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-2bc73530-6d4d-4f96-8541-987e701ce9d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:48.016925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:48.017982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:48.019669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:25:48.022162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 13/28] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:48.033017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc73530-6d4d-4f96-8541-987e701ce9d4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.043831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f0cf-0396-47c1-977d-107fd29a6023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.044502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f0cf-0396-47c1-977d-107fd29a6023 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.044787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f0cf-0396-47c1-977d-107fd29a6023 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.044964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.045368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f0cf-0396-47c1-977d-107fd29a6023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.070973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76f0cf-0396-47c1-977d-107fd29a6023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:48.072851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76f0cf-0396-47c1-977d-107fd29a6023 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-fc76f0cf-0396-47c1-977d-107fd29a6023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:25:48.100898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:48.101762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:25:48.102643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:25:48.102643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:25:48.102643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:25:48.102643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 16/29] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:48.109600 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f0cf-0396-47c1-977d-107fd29a6023 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.242839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc73530-6d4d-4f96-8541-987e701ce9d4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:48.289155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b475824-73fa-43e6-b3e2-31bd7ab3d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.290088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f0cf-0396-47c1-977d-107fd29a6023 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:48.290402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b475824-73fa-43e6-b3e2-31bd7ab3d562 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.290894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b475824-73fa-43e6-b3e2-31bd7ab3d562 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.291418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b475824-73fa-43e6-b3e2-31bd7ab3d562 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.292571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b475824-73fa-43e6-b3e2-31bd7ab3d562 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:48.294033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b475824-73fa-43e6-b3e2-31bd7ab3d562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:48.295786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b475824-73fa-43e6-b3e2-31bd7ab3d562 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:48.307572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 14/30] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:48.308988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b475824-73fa-43e6-b3e2-31bd7ab3d562 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.336191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a136-b575-44f1-bca3-1f746507b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.336818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a136-b575-44f1-bca3-1f746507b38f None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.337099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a136-b575-44f1-bca3-1f746507b38f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.337374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a136-b575-44f1-bca3-1f746507b38f None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.338692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a136-b575-44f1-bca3-1f746507b38f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:48.340560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a136-b575-44f1-bca3-1f746507b38f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:48.390957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.433587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b475824-73fa-43e6-b3e2-31bd7ab3d562 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:48.474455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf3c45-cdb6-4370-b9ff-870db3dcd12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.475128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf3c45-cdb6-4370-b9ff-870db3dcd12e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.475412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf3c45-cdb6-4370-b9ff-870db3dcd12e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.475690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf3c45-cdb6-4370-b9ff-870db3dcd12e None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.476403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf3c45-cdb6-4370-b9ff-870db3dcd12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:48.476720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf3c45-cdb6-4370-b9ff-870db3dcd12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:48.478110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf3c45-cdb6-4370-b9ff-870db3dcd12e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:48.497217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 15/31] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:48.498413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 17/32] 10.222.0.89 () {60 vars in 1131 bytes} [Fri Aug 26 15:25:48 2022] POST /identity/v3/roles => generated 219 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:25:48.499685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a136-b575-44f1-bca3-1f746507b38f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.503657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc29c1d-3bdf-465e-8f23-d43d0ed82349 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.505348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc29c1d-3bdf-465e-8f23-d43d0ed82349 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.505844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc29c1d-3bdf-465e-8f23-d43d0ed82349 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.508074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 16/33] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:48.511948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc29c1d-3bdf-465e-8f23-d43d0ed82349 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.543300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.659183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc29c1d-3bdf-465e-8f23-d43d0ed82349 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:48.689746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.691222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a136-b575-44f1-bca3-1f746507b38f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:48.700397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25a23d-de99-42e9-b7a2-965fbc0f83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.701309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25a23d-de99-42e9-b7a2-965fbc0f83e9 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.701806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25a23d-de99-42e9-b7a2-965fbc0f83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.702304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25a23d-de99-42e9-b7a2-965fbc0f83e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.703246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25a23d-de99-42e9-b7a2-965fbc0f83e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:48.705147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25a23d-de99-42e9-b7a2-965fbc0f83e9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:48.733924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01750e4f-ed7f-480b-bb9f-de7d9462ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:48.734922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01750e4f-ed7f-480b-bb9f-de7d9462ebb9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.735386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01750e4f-ed7f-480b-bb9f-de7d9462ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.735797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01750e4f-ed7f-480b-bb9f-de7d9462ebb9 None admin] PATH_INFO: `/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.737713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01750e4f-ed7f-480b-bb9f-de7d9462ebb9 None admin] RBAC: Authorizing `identity:get_user(user_id=6a0674a0b804427ca12cbbcd5e4a20f5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:48.740039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01750e4f-ed7f-480b-bb9f-de7d9462ebb9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:48.741866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 18/34] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:48 2022] GET /identity/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5 => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:48.743452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf058-378d-4a60-861a-50e8a72d9053 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.743738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf058-378d-4a60-861a-50e8a72d9053 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.744033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf058-378d-4a60-861a-50e8a72d9053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.763622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-06ccf058-378d-4a60-861a-50e8a72d9053 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:48.765164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-06ccf058-378d-4a60-861a-50e8a72d9053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:48.851237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 17/35] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:25:48 2022] POST /identity/v3/projects => generated 301 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:25:48.852739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f6e2-d2d5-4372-afd8-e313227c354b None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.853228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f6e2-d2d5-4372-afd8-e313227c354b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.853655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f6e2-d2d5-4372-afd8-e313227c354b None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.855299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 18/36] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:48.856083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f6e2-d2d5-4372-afd8-e313227c354b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:48.857935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 19/37] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:48.868954 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475c87d-b5ae-4e6c-8f60-870a6402e555 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.869531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475c87d-b5ae-4e6c-8f60-870a6402e555 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.870036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475c87d-b5ae-4e6c-8f60-870a6402e555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.899955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4475c87d-b5ae-4e6c-8f60-870a6402e555 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:48.902338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4475c87d-b5ae-4e6c-8f60-870a6402e555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:48.919632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:48.991761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 20/38] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:48.993578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa068e-080d-49cb-9597-ea90b2873567 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:48.994109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa068e-080d-49cb-9597-ea90b2873567 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:48.994603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa068e-080d-49cb-9597-ea90b2873567 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:48.996258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 21/39] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:49.003781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f6e2-d2d5-4372-afd8-e313227c354b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.005529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ced1f5-3601-4612-b5f5-ca097d1994a3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.006046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ced1f5-3601-4612-b5f5-ca097d1994a3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.006597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ced1f5-3601-4612-b5f5-ca097d1994a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.040371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f3ced1f5-3601-4612-b5f5-ca097d1994a3 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:49.041622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f3ced1f5-3601-4612-b5f5-ca097d1994a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:49.140081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 22/40] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:49.140081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ced1f5-3601-4612-b5f5-ca097d1994a3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.164044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27021-0e4d-410a-b230-2e725be35883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.164693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27021-0e4d-410a-b230-2e725be35883 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.165228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27021-0e4d-410a-b230-2e725be35883 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.165511 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27021-0e4d-410a-b230-2e725be35883 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.167474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd27021-0e4d-410a-b230-2e725be35883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.169969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd27021-0e4d-410a-b230-2e725be35883 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.172221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 19/41] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:49.177554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27021-0e4d-410a-b230-2e725be35883 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.227792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:49.232978 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:49.264274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ced1f5-3601-4612-b5f5-ca097d1994a3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.287910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27021-0e4d-410a-b230-2e725be35883 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.310775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc45e9-2986-49a8-9763-3711cbcfbc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.311517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc45e9-2986-49a8-9763-3711cbcfbc9d None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.311803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc45e9-2986-49a8-9763-3711cbcfbc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.312082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc45e9-2986-49a8-9763-3711cbcfbc9d None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.312764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc45e9-2986-49a8-9763-3711cbcfbc9d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.314173 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc45e9-2986-49a8-9763-3711cbcfbc9d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.327129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea9865-856f-4995-a927-1aa66a5d67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.327931 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9865-856f-4995-a927-1aa66a5d67dc None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.328215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9865-856f-4995-a927-1aa66a5d67dc None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.328496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9865-856f-4995-a927-1aa66a5d67dc None admin] PATH_INFO: `/v3/domains/default/users/6a0674a0b804427ca12cbbcd5e4a20f5/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.335112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 23/42] 10.222.0.89 () {60 vars in 1131 bytes} [Fri Aug 26 15:25:49 2022] POST /identity/v3/roles => generated 225 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:25:49.335294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea9865-856f-4995-a927-1aa66a5d67dc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6a0674a0b804427ca12cbbcd5e4a20f5, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.335402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc45e9-2986-49a8-9763-3711cbcfbc9d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.335492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea9865-856f-4995-a927-1aa66a5d67dc None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.356083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 20/43] 10.222.0.89 () {58 vars in 1361 bytes} [Fri Aug 26 15:25:49 2022] PUT /identity/v3/domains/default/users/6a0674a0b804427ca12cbbcd5e4a20f5/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:25:49.447145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea9865-856f-4995-a927-1aa66a5d67dc None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.465861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc45e9-2986-49a8-9763-3711cbcfbc9d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.509657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe23b75-d450-4f9c-91da-6813d2413bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.510611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23b75-d450-4f9c-91da-6813d2413bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.511187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23b75-d450-4f9c-91da-6813d2413bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.511674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23b75-d450-4f9c-91da-6813d2413bc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.513228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe23b75-d450-4f9c-91da-6813d2413bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.514734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe23b75-d450-4f9c-91da-6813d2413bc2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.517583 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 24/44] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:49.524637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe23b75-d450-4f9c-91da-6813d2413bc2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:49.532214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:49.585450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea9865-856f-4995-a927-1aa66a5d67dc None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.594270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:49.628757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61331f5-b5d9-46fe-8e12-3346e46ba0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.629550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61331f5-b5d9-46fe-8e12-3346e46ba0af None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.629842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61331f5-b5d9-46fe-8e12-3346e46ba0af None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.630117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61331f5-b5d9-46fe-8e12-3346e46ba0af None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.630791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61331f5-b5d9-46fe-8e12-3346e46ba0af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.632331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61331f5-b5d9-46fe-8e12-3346e46ba0af None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.651438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 21/45] 10.222.0.89 () {60 vars in 1131 bytes} [Fri Aug 26 15:25:49 2022] POST /identity/v3/roles => generated 223 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:25:49.654291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe23b75-d450-4f9c-91da-6813d2413bc2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:49.705520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263ca88-7a46-4019-9ff1-73a6393c8f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:49.706091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263ca88-7a46-4019-9ff1-73a6393c8f40 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:49.706379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263ca88-7a46-4019-9ff1-73a6393c8f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:49.706659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263ca88-7a46-4019-9ff1-73a6393c8f40 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:49.707415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263ca88-7a46-4019-9ff1-73a6393c8f40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:49.709388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263ca88-7a46-4019-9ff1-73a6393c8f40 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:49.743818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 25/46] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:25:49 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:25:51.318290 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925c22-abd6-46f1-90ac-55f947301d09 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:51.318805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925c22-abd6-46f1-90ac-55f947301d09 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:51.318886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25925c22-abd6-46f1-90ac-55f947301d09 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:51.320216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 22/47] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:51.325588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bedf2-7109-48e7-a19e-4ad59f59753d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:51.325992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bedf2-7109-48e7-a19e-4ad59f59753d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:51.326295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bedf2-7109-48e7-a19e-4ad59f59753d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:51.345061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e81bedf2-7109-48e7-a19e-4ad59f59753d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:51.346255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e81bedf2-7109-48e7-a19e-4ad59f59753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:51.397141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:51.415391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 26/48] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:51.668492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04bf16-1ae4-40d2-9324-914f1be9bf44 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:51.668705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04bf16-1ae4-40d2-9324-914f1be9bf44 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:51.669063 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04bf16-1ae4-40d2-9324-914f1be9bf44 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:51.670413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 23/49] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:51.675678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab09ec-a800-43b8-b86a-3d7655eaea97 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:51.675965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab09ec-a800-43b8-b86a-3d7655eaea97 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:51.676267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab09ec-a800-43b8-b86a-3d7655eaea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:51.684334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04bf16-1ae4-40d2-9324-914f1be9bf44 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:51.694578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9eab09ec-a800-43b8-b86a-3d7655eaea97 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:51.695795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9eab09ec-a800-43b8-b86a-3d7655eaea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:51.762310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 27/50] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:51.789128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04bf16-1ae4-40d2-9324-914f1be9bf44 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:51.824630 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb63fa-3e9e-49a8-8d2f-db326e407250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:51.825264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb63fa-3e9e-49a8-8d2f-db326e407250 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:51.825549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb63fa-3e9e-49a8-8d2f-db326e407250 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:51.825830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb63fa-3e9e-49a8-8d2f-db326e407250 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:51.836255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb63fa-3e9e-49a8-8d2f-db326e407250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-56eb63fa-3e9e-49a8-8d2f-db326e407250 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:51.841113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:51.842219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:25:51.843007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 24/51] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:25:51.850149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab09ec-a800-43b8-b86a-3d7655eaea97 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.031681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb63fa-3e9e-49a8-8d2f-db326e407250 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.055340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab09ec-a800-43b8-b86a-3d7655eaea97 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.059190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:52.073344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:52.095338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee7180-79b6-4ce1-944e-77d0f1b312a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.096164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7180-79b6-4ce1-944e-77d0f1b312a9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.096485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7180-79b6-4ce1-944e-77d0f1b312a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.096778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7180-79b6-4ce1-944e-77d0f1b312a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.097555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee7180-79b6-4ce1-944e-77d0f1b312a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:52.097874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee7180-79b6-4ce1-944e-77d0f1b312a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:52.099878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee7180-79b6-4ce1-944e-77d0f1b312a9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:52.111699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 28/52] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:52.117155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee7180-79b6-4ce1-944e-77d0f1b312a9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.138377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb63fa-3e9e-49a8-8d2f-db326e407250 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.172146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994582d-3d4b-4183-bef1-92733674e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.172776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994582d-3d4b-4183-bef1-92733674e343 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.173063 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994582d-3d4b-4183-bef1-92733674e343 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.173338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994582d-3d4b-4183-bef1-92733674e343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.174451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994582d-3d4b-4183-bef1-92733674e343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:52.175933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994582d-3d4b-4183-bef1-92733674e343 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:52.177698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 25/53] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:52.182903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994582d-3d4b-4183-bef1-92733674e343 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.217262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee7180-79b6-4ce1-944e-77d0f1b312a9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.261411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9193d-e88d-4383-ab04-52775d0ffb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.262060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9193d-e88d-4383-ab04-52775d0ffb7d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.262659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9193d-e88d-4383-ab04-52775d0ffb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.262965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9193d-e88d-4383-ab04-52775d0ffb7d None admin] PATH_INFO: `/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.264129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9193d-e88d-4383-ab04-52775d0ffb7d None admin] RBAC: Authorizing `identity:get_user(user_id=6a0674a0b804427ca12cbbcd5e4a20f5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:52.265591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9193d-e88d-4383-ab04-52775d0ffb7d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:52.267207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 29/54] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:52 2022] GET /identity/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:25:52.273000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9193d-e88d-4383-ab04-52775d0ffb7d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.277506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:52.284433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994582d-3d4b-4183-bef1-92733674e343 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.319559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:52.319782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6245b-cef0-43c9-a3dc-f7a922433ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.320400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6245b-cef0-43c9-a3dc-f7a922433ca3 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.320687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6245b-cef0-43c9-a3dc-f7a922433ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.320988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6245b-cef0-43c9-a3dc-f7a922433ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.321758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6245b-cef0-43c9-a3dc-f7a922433ca3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:52.323282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6245b-cef0-43c9-a3dc-f7a922433ca3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:52.350190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 26/55] 10.222.0.89 () {60 vars in 1140 bytes} [Fri Aug 26 15:25:52 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:25:52.375494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9193d-e88d-4383-ab04-52775d0ffb7d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.414028 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945edce-2d35-4e57-84e0-92afa07ebd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.414821 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945edce-2d35-4e57-84e0-92afa07ebd38 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.415200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945edce-2d35-4e57-84e0-92afa07ebd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.415479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945edce-2d35-4e57-84e0-92afa07ebd38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.416702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945edce-2d35-4e57-84e0-92afa07ebd38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:52.418188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945edce-2d35-4e57-84e0-92afa07ebd38 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:52.419869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 30/56] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:52.425897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6245b-cef0-43c9-a3dc-f7a922433ca3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:52.532757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6245b-cef0-43c9-a3dc-f7a922433ca3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:52.566553 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b42e8c-f2b9-401e-8d04-c678307cb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:52.567698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b42e8c-f2b9-401e-8d04-c678307cb613 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:52.567989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b42e8c-f2b9-401e-8d04-c678307cb613 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:52.568270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b42e8c-f2b9-401e-8d04-c678307cb613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:52.569008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b42e8c-f2b9-401e-8d04-c678307cb613 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.domain.id=default, user.id=6a0674a0b804427ca12cbbcd5e4a20f5) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:52.569323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b42e8c-f2b9-401e-8d04-c678307cb613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:52.570798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b42e8c-f2b9-401e-8d04-c678307cb613 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:52.576534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 27/57] 10.222.0.89 () {56 vars in 1322 bytes} [Fri Aug 26 15:25:52 2022] GET /identity/v3/role_assignments?user.id=6a0674a0b804427ca12cbbcd5e4a20f5&scope.domain.id=default&role.id=609b1a993a394f0e900e17edccebaea5 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:54.261860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137d17-47b4-4c65-bcbf-e6a132ea3901 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:54.262345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137d17-47b4-4c65-bcbf-e6a132ea3901 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:54.262345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137d17-47b4-4c65-bcbf-e6a132ea3901 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:54.264624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 31/58] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:54.270238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae003-b910-4fbf-92c7-fa879071df10 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:54.270648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae003-b910-4fbf-92c7-fa879071df10 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:54.270804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae003-b910-4fbf-92c7-fa879071df10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:54.288735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1c9ae003-b910-4fbf-92c7-fa879071df10 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:54.290242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1c9ae003-b910-4fbf-92c7-fa879071df10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:54.292970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:54.355479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 28/59] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:25:54.619895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137d17-47b4-4c65-bcbf-e6a132ea3901 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:54.727255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137d17-47b4-4c65-bcbf-e6a132ea3901 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:54.740967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:54.760018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4806d8-f044-44d4-87b3-be7741264aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:54.760639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4806d8-f044-44d4-87b3-be7741264aed None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:54.760916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4806d8-f044-44d4-87b3-be7741264aed None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:54.761186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4806d8-f044-44d4-87b3-be7741264aed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:54.762274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4806d8-f044-44d4-87b3-be7741264aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:54.763731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4806d8-f044-44d4-87b3-be7741264aed None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:54.765262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 32/60] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:54.771016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ae003-b910-4fbf-92c7-fa879071df10 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:54.870043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ae003-b910-4fbf-92c7-fa879071df10 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:54.905518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05674c22-ee5d-4f73-9bfd-c20d1b56597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:54.906131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674c22-ee5d-4f73-9bfd-c20d1b56597a None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:54.906413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674c22-ee5d-4f73-9bfd-c20d1b56597a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:54.906685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674c22-ee5d-4f73-9bfd-c20d1b56597a None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:54.907377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05674c22-ee5d-4f73-9bfd-c20d1b56597a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:54.908820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05674c22-ee5d-4f73-9bfd-c20d1b56597a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:54.925350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:54.938523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 29/61] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:25:54 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:25:57.958541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760725c5-4f9c-4054-bedb-032241f18faf None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:57.959569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760725c5-4f9c-4054-bedb-032241f18faf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:57.960066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760725c5-4f9c-4054-bedb-032241f18faf None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:57.961601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 33/62] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:57.966908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539fc1a-90ad-401c-9e8f-e1c7e1af5ba6 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:57.967760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539fc1a-90ad-401c-9e8f-e1c7e1af5ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:57.968232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539fc1a-90ad-401c-9e8f-e1c7e1af5ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:57.994793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c539fc1a-90ad-401c-9e8f-e1c7e1af5ba6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:57.996331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c539fc1a-90ad-401c-9e8f-e1c7e1af5ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:58.005318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695871e-141e-43e3-8484-3b0eda769977 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.005902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695871e-141e-43e3-8484-3b0eda769977 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.006371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695871e-141e-43e3-8484-3b0eda769977 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.007935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 34/63] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:58.013287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253db38-6fe7-4014-ae07-bde657cb2f45 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.013817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253db38-6fe7-4014-ae07-bde657cb2f45 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.014288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253db38-6fe7-4014-ae07-bde657cb2f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.038733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d253db38-6fe7-4014-ae07-bde657cb2f45 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:58.040420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d253db38-6fe7-4014-ae07-bde657cb2f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:58.117391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 30/64] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:58.156243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dced38-2552-4e05-9872-860e134130d0 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.156710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 35/65] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:25:58.157141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dced38-2552-4e05-9872-860e134130d0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.157644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dced38-2552-4e05-9872-860e134130d0 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.159200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 31/66] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:25:58.165092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa1ee-1862-4298-ab26-3318f329991f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.165384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa1ee-1862-4298-ab26-3318f329991f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.165666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa1ee-1862-4298-ab26-3318f329991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.183726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-794fa1ee-1862-4298-ab26-3318f329991f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:58.184924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-794fa1ee-1862-4298-ab26-3318f329991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:58.270757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 36/67] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:58.502261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dced38-2552-4e05-9872-860e134130d0 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:58.528587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa1ee-1862-4298-ab26-3318f329991f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:58.606401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:58.661903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dced38-2552-4e05-9872-860e134130d0 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:58.673818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa1ee-1862-4298-ab26-3318f329991f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:58.689819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:58.700198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca064a-b6b4-4f92-a978-62805d3cdc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:58.700854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca064a-b6b4-4f92-a978-62805d3cdc41 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.701141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca064a-b6b4-4f92-a978-62805d3cdc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.701687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca064a-b6b4-4f92-a978-62805d3cdc41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.712902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca064a-b6b4-4f92-a978-62805d3cdc41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:58.715195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe190d9c-a450-41e9-ac2c-8e515f183632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:58.715850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe190d9c-a450-41e9-ac2c-8e515f183632 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.716133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe190d9c-a450-41e9-ac2c-8e515f183632 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.716406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe190d9c-a450-41e9-ac2c-8e515f183632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-73ca064a-b6b4-4f92-a978-62805d3cdc41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:58.718137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:58.719186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:25:58.719980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 32/68] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:58.720598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca064a-b6b4-4f92-a978-62805d3cdc41 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:58.728949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe190d9c-a450-41e9-ac2c-8e515f183632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-fe190d9c-a450-41e9-ac2c-8e515f183632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:58.736445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:58.737255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:25:58.737988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 37/69] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:58.739647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8542a1-dc55-4abe-a728-0daca57275c0 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.739647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8542a1-dc55-4abe-a728-0daca57275c0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.739935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8542a1-dc55-4abe-a728-0daca57275c0 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.741015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 38/70] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:58.742023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07861e35-7e7c-40e8-901d-7da30a79fbbd None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.742307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07861e35-7e7c-40e8-901d-7da30a79fbbd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.742584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07861e35-7e7c-40e8-901d-7da30a79fbbd None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.743982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 39/71] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:25:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:25:58.745959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07861e35-7e7c-40e8-901d-7da30a79fbbd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:58.821721 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca064a-b6b4-4f92-a978-62805d3cdc41 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:58.851901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07861e35-7e7c-40e8-901d-7da30a79fbbd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:58.853529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:58.854341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312496a9-7c97-4db9-914d-1ea115a7894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:58.854990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312496a9-7c97-4db9-914d-1ea115a7894a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.855277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312496a9-7c97-4db9-914d-1ea115a7894a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.855570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312496a9-7c97-4db9-914d-1ea115a7894a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.866037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312496a9-7c97-4db9-914d-1ea115a7894a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-312496a9-7c97-4db9-914d-1ea115a7894a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:58.870802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:58.871684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:25:58.872408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 33/72] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:25:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:58.873076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312496a9-7c97-4db9-914d-1ea115a7894a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:58.887670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ae923-6eb8-4e24-9e84-7117ddc0031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:58.888277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ae923-6eb8-4e24-9e84-7117ddc0031a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.888555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ae923-6eb8-4e24-9e84-7117ddc0031a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.888833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ae923-6eb8-4e24-9e84-7117ddc0031a None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.889499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ae923-6eb8-4e24-9e84-7117ddc0031a None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:58.889803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ae923-6eb8-4e24-9e84-7117ddc0031a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:58.891221 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ae923-6eb8-4e24-9e84-7117ddc0031a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:58.900148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 40/73] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:25:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:58.901204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0289-063c-41f8-943a-6dd8abb0ce29 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.901490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0289-063c-41f8-943a-6dd8abb0ce29 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.901769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f0289-063c-41f8-943a-6dd8abb0ce29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:58.918914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-eb9f0289-063c-41f8-943a-6dd8abb0ce29 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:58.920124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-eb9f0289-063c-41f8-943a-6dd8abb0ce29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:58.925287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:58.977853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312496a9-7c97-4db9-914d-1ea115a7894a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:58.984156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 41/74] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:58.985470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7846ff2-33db-45d9-a822-fa09ccc3ca6b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:58.985763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7846ff2-33db-45d9-a822-fa09ccc3ca6b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:58.986039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7846ff2-33db-45d9-a822-fa09ccc3ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.010918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b7846ff2-33db-45d9-a822-fa09ccc3ca6b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:25:59.012228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b7846ff2-33db-45d9-a822-fa09ccc3ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:25:59.013902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ece276-6ab9-49f2-a7df-8b90c5f72c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.014514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ece276-6ab9-49f2-a7df-8b90c5f72c19 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.014797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ece276-6ab9-49f2-a7df-8b90c5f72c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.015726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ece276-6ab9-49f2-a7df-8b90c5f72c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.015833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ece276-6ab9-49f2-a7df-8b90c5f72c19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:59.016088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ece276-6ab9-49f2-a7df-8b90c5f72c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.017494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ece276-6ab9-49f2-a7df-8b90c5f72c19 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.026836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 34/75] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:59.031562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ece276-6ab9-49f2-a7df-8b90c5f72c19 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.086264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 42/76] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:25:59.087300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7846ff2-33db-45d9-a822-fa09ccc3ca6b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.116675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.160497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ece276-6ab9-49f2-a7df-8b90c5f72c19 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.172009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.199963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f425835-e892-41df-b719-a1a3ec947012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.200746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f425835-e892-41df-b719-a1a3ec947012 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.201157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f425835-e892-41df-b719-a1a3ec947012 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.201779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f425835-e892-41df-b719-a1a3ec947012 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.202712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f425835-e892-41df-b719-a1a3ec947012 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:25:59.203154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f425835-e892-41df-b719-a1a3ec947012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.204740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f425835-e892-41df-b719-a1a3ec947012 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.208835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7846ff2-33db-45d9-a822-fa09ccc3ca6b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.213712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 35/77] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:59.219520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f425835-e892-41df-b719-a1a3ec947012 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.246959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16583-ff6e-4ee9-8454-d5eb9e4e117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.247861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16583-ff6e-4ee9-8454-d5eb9e4e117c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.248277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16583-ff6e-4ee9-8454-d5eb9e4e117c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.248687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16583-ff6e-4ee9-8454-d5eb9e4e117c None admin] PATH_INFO: `/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.264765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a16583-ff6e-4ee9-8454-d5eb9e4e117c None admin] RBAC: Authorizing `identity:get_user(user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.266511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a16583-ff6e-4ee9-8454-d5eb9e4e117c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.268710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 43/78] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:59.269647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16583-ff6e-4ee9-8454-d5eb9e4e117c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.327574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f425835-e892-41df-b719-a1a3ec947012 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.354630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.364134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef22e5-f3e9-4b62-a919-e3725b406734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.364760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef22e5-f3e9-4b62-a919-e3725b406734 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.365039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef22e5-f3e9-4b62-a919-e3725b406734 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.365314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef22e5-f3e9-4b62-a919-e3725b406734 None admin] PATH_INFO: `/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.366454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef22e5-f3e9-4b62-a919-e3725b406734 None admin] RBAC: Authorizing `identity:get_user(user_id=6a0674a0b804427ca12cbbcd5e4a20f5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.367923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef22e5-f3e9-4b62-a919-e3725b406734 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.369652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 36/79] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:59.370408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef22e5-f3e9-4b62-a919-e3725b406734 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.378046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16583-ff6e-4ee9-8454-d5eb9e4e117c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.412003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.417946 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ed9d2-d997-4423-9d3d-1749973d664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.418593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ed9d2-d997-4423-9d3d-1749973d664d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.418877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ed9d2-d997-4423-9d3d-1749973d664d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.419187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ed9d2-d997-4423-9d3d-1749973d664d None admin] PATH_INFO: `/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.420316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ed9d2-d997-4423-9d3d-1749973d664d None admin] RBAC: Authorizing `identity:get_user(user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.421756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ed9d2-d997-4423-9d3d-1749973d664d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.423378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 44/80] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:59.423378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ed9d2-d997-4423-9d3d-1749973d664d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.475609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef22e5-f3e9-4b62-a919-e3725b406734 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.508851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44962-495d-4a6d-bc0b-d9c266cf6969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.509487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44962-495d-4a6d-bc0b-d9c266cf6969 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.509770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44962-495d-4a6d-bc0b-d9c266cf6969 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.510045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44962-495d-4a6d-bc0b-d9c266cf6969 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.520137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c44962-495d-4a6d-bc0b-d9c266cf6969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:25:59.520598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ed9d2-d997-4423-9d3d-1749973d664d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-f4c44962-495d-4a6d-bc0b-d9c266cf6969 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:25:59.525330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:25:59.526180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 37/81] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:25:59.527638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44962-495d-4a6d-bc0b-d9c266cf6969 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.555068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2a549-b6d6-4e6d-b7ff-4f2b2e988faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.555683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2a549-b6d6-4e6d-b7ff-4f2b2e988faa None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.555965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2a549-b6d6-4e6d-b7ff-4f2b2e988faa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.556246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2a549-b6d6-4e6d-b7ff-4f2b2e988faa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.574452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.621861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.622708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2a549-b6d6-4e6d-b7ff-4f2b2e988faa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.624239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2a549-b6d6-4e6d-b7ff-4f2b2e988faa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.625189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44962-495d-4a6d-bc0b-d9c266cf6969 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.659081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6324ed-e3a7-4681-ab31-7a4fc1cc951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.659716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6324ed-e3a7-4681-ab31-7a4fc1cc951c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.660523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6324ed-e3a7-4681-ab31-7a4fc1cc951c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.660805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6324ed-e3a7-4681-ab31-7a4fc1cc951c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.661939 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6324ed-e3a7-4681-ab31-7a4fc1cc951c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.663438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6324ed-e3a7-4681-ab31-7a4fc1cc951c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.665015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 38/82] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:25:59.669581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6324ed-e3a7-4681-ab31-7a4fc1cc951c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.723540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 45/83] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:25:59.724682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2a549-b6d6-4e6d-b7ff-4f2b2e988faa None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:25:59.771574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6324ed-e3a7-4681-ab31-7a4fc1cc951c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.772451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.806222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3fb0-5942-4947-b2af-12339a2252cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.806838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3fb0-5942-4947-b2af-12339a2252cd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.807164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3fb0-5942-4947-b2af-12339a2252cd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.807444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3fb0-5942-4947-b2af-12339a2252cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.823202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2a549-b6d6-4e6d-b7ff-4f2b2e988faa None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:25:59.841535 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.857414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a23d-f89d-4edb-bd59-d9222d701639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:25:59.858024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a23d-f89d-4edb-bd59-d9222d701639 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:25:59.858303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a23d-f89d-4edb-bd59-d9222d701639 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:25:59.858576 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a23d-f89d-4edb-bd59-d9222d701639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:25:59.877430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf3fb0-5942-4947-b2af-12339a2252cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.879403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf3fb0-5942-4947-b2af-12339a2252cd None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.925984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9a23d-f89d-4edb-bd59-d9222d701639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:25:59.927505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9a23d-f89d-4edb-bd59-d9222d701639 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:25:59.974323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:25:59.976619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 39/84] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:25:59.977250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3fb0-5942-4947-b2af-12339a2252cd None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.024840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 46/85] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:00.025659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a23d-f89d-4edb-bd59-d9222d701639 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.046842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.081134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3fb0-5942-4947-b2af-12339a2252cd None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.114610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf71aef-75b7-4a30-9299-50c3e242e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.115245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf71aef-75b7-4a30-9299-50c3e242e69f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.115528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf71aef-75b7-4a30-9299-50c3e242e69f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.115805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf71aef-75b7-4a30-9299-50c3e242e69f None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.116467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf71aef-75b7-4a30-9299-50c3e242e69f None admin] RBAC: Adding query filter params (name=member) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:00.116772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf71aef-75b7-4a30-9299-50c3e242e69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.118133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf71aef-75b7-4a30-9299-50c3e242e69f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.121316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a23d-f89d-4edb-bd59-d9222d701639 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.126089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 40/86] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:25:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.126867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf71aef-75b7-4a30-9299-50c3e242e69f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.154881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f21a48-b151-4bc3-bea5-16b3c9358dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.155462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f21a48-b151-4bc3-bea5-16b3c9358dd7 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.155748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f21a48-b151-4bc3-bea5-16b3c9358dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.156025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f21a48-b151-4bc3-bea5-16b3c9358dd7 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.156678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f21a48-b151-4bc3-bea5-16b3c9358dd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.158138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f21a48-b151-4bc3-bea5-16b3c9358dd7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.184631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 47/87] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:00 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:00.185447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f21a48-b151-4bc3-bea5-16b3c9358dd7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.194200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.240983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf71aef-75b7-4a30-9299-50c3e242e69f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.269790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.281264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d0b61-bec6-46b8-919e-0015a43cce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.281915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d0b61-bec6-46b8-919e-0015a43cce2a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.282203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d0b61-bec6-46b8-919e-0015a43cce2a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.282723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d0b61-bec6-46b8-919e-0015a43cce2a None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.283739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d0b61-bec6-46b8-919e-0015a43cce2a None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.285275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d0b61-bec6-46b8-919e-0015a43cce2a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.291809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 41/88] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.291809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d0b61-bec6-46b8-919e-0015a43cce2a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.309081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f21a48-b151-4bc3-bea5-16b3c9358dd7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.352775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddffa41-5f53-4b44-8f6b-0821fd5aa25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.353773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddffa41-5f53-4b44-8f6b-0821fd5aa25b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.354067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddffa41-5f53-4b44-8f6b-0821fd5aa25b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.354345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddffa41-5f53-4b44-8f6b-0821fd5aa25b None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.355526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddffa41-5f53-4b44-8f6b-0821fd5aa25b None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.356989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddffa41-5f53-4b44-8f6b-0821fd5aa25b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.363079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 48/89] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.363079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddffa41-5f53-4b44-8f6b-0821fd5aa25b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.412758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d0b61-bec6-46b8-919e-0015a43cce2a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.452090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.462673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00d303-c41c-4f21-8328-afc9d126e87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.463860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d303-c41c-4f21-8328-afc9d126e87d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.464350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d303-c41c-4f21-8328-afc9d126e87d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.464768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00d303-c41c-4f21-8328-afc9d126e87d None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.466269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00d303-c41c-4f21-8328-afc9d126e87d None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.467842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00d303-c41c-4f21-8328-afc9d126e87d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.469701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 42/90] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.470286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00d303-c41c-4f21-8328-afc9d126e87d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.485689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddffa41-5f53-4b44-8f6b-0821fd5aa25b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.530453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91487300-b2d0-4e1e-a90f-8746649d2fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.531399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91487300-b2d0-4e1e-a90f-8746649d2fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.531835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91487300-b2d0-4e1e-a90f-8746649d2fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.532108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91487300-b2d0-4e1e-a90f-8746649d2fd2 None admin] PATH_INFO: `/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.533520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91487300-b2d0-4e1e-a90f-8746649d2fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.534745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91487300-b2d0-4e1e-a90f-8746649d2fd2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.536708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 49/91] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.537231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91487300-b2d0-4e1e-a90f-8746649d2fd2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.546197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.601365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00d303-c41c-4f21-8328-afc9d126e87d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.648545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14ae49-dbc8-48e2-b85e-a882d08a2320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.649787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14ae49-dbc8-48e2-b85e-a882d08a2320 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.650657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14ae49-dbc8-48e2-b85e-a882d08a2320 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.651423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14ae49-dbc8-48e2-b85e-a882d08a2320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.652664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14ae49-dbc8-48e2-b85e-a882d08a2320 None admin] RBAC: Adding query filter params (role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=87d64932a5ad41f8b5467e542488e3c8, user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:00.653624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14ae49-dbc8-48e2-b85e-a882d08a2320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.655846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14ae49-dbc8-48e2-b85e-a882d08a2320 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.659223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91487300-b2d0-4e1e-a90f-8746649d2fd2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.664662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 43/92] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/role_assignments?user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=79bef6f5048d441d883bb015c7887170 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.665698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14ae49-dbc8-48e2-b85e-a882d08a2320 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.700735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec306ef-38ce-47ad-ab76-e5d465b6e9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.702222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec306ef-38ce-47ad-ab76-e5d465b6e9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.702530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec306ef-38ce-47ad-ab76-e5d465b6e9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.705369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec306ef-38ce-47ad-ab76-e5d465b6e9e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.706244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec306ef-38ce-47ad-ab76-e5d465b6e9e6 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=87d64932a5ad41f8b5467e542488e3c8, user.id=6a0674a0b804427ca12cbbcd5e4a20f5) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:00.707021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec306ef-38ce-47ad-ab76-e5d465b6e9e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.709346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec306ef-38ce-47ad-ab76-e5d465b6e9e6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.723122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 50/93] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/role_assignments?user.id=6a0674a0b804427ca12cbbcd5e4a20f5&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=609b1a993a394f0e900e17edccebaea5 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.724104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec306ef-38ce-47ad-ab76-e5d465b6e9e6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:00.743942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.809472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14ae49-dbc8-48e2-b85e-a882d08a2320 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.846829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:00.859411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11344c96-049f-4415-a2af-66c603a7387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.860602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11344c96-049f-4415-a2af-66c603a7387f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.861092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11344c96-049f-4415-a2af-66c603a7387f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.861709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11344c96-049f-4415-a2af-66c603a7387f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:00.863031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11344c96-049f-4415-a2af-66c603a7387f None admin] RBAC: Adding query filter params (role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=87d64932a5ad41f8b5467e542488e3c8, user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:00.863590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11344c96-049f-4415-a2af-66c603a7387f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:00.865314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11344c96-049f-4415-a2af-66c603a7387f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:00.872915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 44/94] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/role_assignments?user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=88da3cfff1d74296962f08ef7829479c => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:00.942467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec306ef-38ce-47ad-ab76-e5d465b6e9e6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:00.993758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640bf5c-c960-492d-93bc-53c50cd40bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:00.994447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640bf5c-c960-492d-93bc-53c50cd40bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:00.994732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640bf5c-c960-492d-93bc-53c50cd40bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:00.995176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640bf5c-c960-492d-93bc-53c50cd40bc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.077948 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640bf5c-c960-492d-93bc-53c50cd40bc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.079484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640bf5c-c960-492d-93bc-53c50cd40bc6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.087854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:01.189487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 51/95] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:01.195124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11344c96-049f-4415-a2af-66c603a7387f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:01.311315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11344c96-049f-4415-a2af-66c603a7387f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.350868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a1823-b302-40a6-8cc5-e9bb4f0cc007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.351546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a1823-b302-40a6-8cc5-e9bb4f0cc007 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.351835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a1823-b302-40a6-8cc5-e9bb4f0cc007 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:01.352117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a1823-b302-40a6-8cc5-e9bb4f0cc007 None admin] PATH_INFO: `/v3/projects/1ccbc6d2484f41b584482f99f6752e71` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.353275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a1823-b302-40a6-8cc5-e9bb4f0cc007 None admin] RBAC: Authorizing `identity:get_project(project_id=1ccbc6d2484f41b584482f99f6752e71)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.354730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a1823-b302-40a6-8cc5-e9bb4f0cc007 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.356415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 45/96] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:01 2022] GET /identity/v3/projects/1ccbc6d2484f41b584482f99f6752e71 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:01.362390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640bf5c-c960-492d-93bc-53c50cd40bc6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:01.489325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640bf5c-c960-492d-93bc-53c50cd40bc6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:01.498643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:01.536654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f256a-8eda-4209-8029-bee9f0a8b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:01.537269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f256a-8eda-4209-8029-bee9f0a8b97a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:01.537605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f256a-8eda-4209-8029-bee9f0a8b97a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:01.537936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f256a-8eda-4209-8029-bee9f0a8b97a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:01.538674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f256a-8eda-4209-8029-bee9f0a8b97a None admin] RBAC: Adding query filter params (role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=1ccbc6d2484f41b584482f99f6752e71, user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:01.539054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f256a-8eda-4209-8029-bee9f0a8b97a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:01.540504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f256a-8eda-4209-8029-bee9f0a8b97a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:01.549598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 52/97] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:01 2022] GET /identity/v3/role_assignments?user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f&scope.project.id=1ccbc6d2484f41b584482f99f6752e71&role.id=79bef6f5048d441d883bb015c7887170 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:02.906385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8725c3-9014-4747-9aec-4c981cc2490d None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:02.906888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8725c3-9014-4747-9aec-4c981cc2490d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:02.906983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8725c3-9014-4747-9aec-4c981cc2490d None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:02.908343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 46/98] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:02.919922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e385853-eaac-48e3-b08b-ffeb24937636 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:02.920388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e385853-eaac-48e3-b08b-ffeb24937636 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:02.920584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e385853-eaac-48e3-b08b-ffeb24937636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:02.944503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1e385853-eaac-48e3-b08b-ffeb24937636 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:02.945706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1e385853-eaac-48e3-b08b-ffeb24937636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:03.025396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 53/99] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:03.332580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7f8d-0792-419e-b349-39aee447025a None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:03.332951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7f8d-0792-419e-b349-39aee447025a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:03.333162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7f8d-0792-419e-b349-39aee447025a None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:03.334686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 47/100] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:03.340170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296ae63-a4ff-4048-b5a9-aaca8bc3e2bf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:03.340465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296ae63-a4ff-4048-b5a9-aaca8bc3e2bf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:03.340748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296ae63-a4ff-4048-b5a9-aaca8bc3e2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:03.365319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8296ae63-a4ff-4048-b5a9-aaca8bc3e2bf None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:03.366520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8296ae63-a4ff-4048-b5a9-aaca8bc3e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:03.404146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e580-b917-4223-b31c-d37919002a4c None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:03.404471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e580-b917-4223-b31c-d37919002a4c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:03.404717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e580-b917-4223-b31c-d37919002a4c None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:03.406227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 48/101] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:03.432133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd6931-d0f9-4996-94b8-0febbffc8cc7 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:03.432431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd6931-d0f9-4996-94b8-0febbffc8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:03.432688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd6931-d0f9-4996-94b8-0febbffc8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:03.454489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 54/102] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:03.465850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae8cf-2728-4c38-8dfe-0ccd93645094 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:03.466136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae8cf-2728-4c38-8dfe-0ccd93645094 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:03.466406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae8cf-2728-4c38-8dfe-0ccd93645094 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:03.467938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 55/103] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:03.472950 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-84cd6931-d0f9-4996-94b8-0febbffc8cc7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:03.474170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-84cd6931-d0f9-4996-94b8-0febbffc8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:03.478746 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebc9f-aa6e-4876-bb6c-25a2c9ed46c7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:03.479072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebc9f-aa6e-4876-bb6c-25a2c9ed46c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:03.479357 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebc9f-aa6e-4876-bb6c-25a2c9ed46c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:03.510685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ab6ebc9f-aa6e-4876-bb6c-25a2c9ed46c7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:03.511912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ab6ebc9f-aa6e-4876-bb6c-25a2c9ed46c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:03.550241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:03.557545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:03.575314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 49/104] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:03.576263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd6931-d0f9-4996-94b8-0febbffc8cc7 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:03.606518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 56/105] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:03.735354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd6931-d0f9-4996-94b8-0febbffc8cc7 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:03.755066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebc9f-aa6e-4876-bb6c-25a2c9ed46c7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:03.803373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136b619-1a35-4900-af5c-c6504713e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:03.803636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b619-1a35-4900-af5c-c6504713e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:03.803925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b619-1a35-4900-af5c-c6504713e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:03.804199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b619-1a35-4900-af5c-c6504713e1f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:03.840294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136b619-1a35-4900-af5c-c6504713e1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-c136b619-1a35-4900-af5c-c6504713e1f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:03.845055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:03.845884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:03.846641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 50/106] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:03.855659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136b619-1a35-4900-af5c-c6504713e1f2 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:03.984012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.011765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebc9f-aa6e-4876-bb6c-25a2c9ed46c7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.051166 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136b619-1a35-4900-af5c-c6504713e1f2 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.055703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878156cb-df06-4961-837f-4121b7f27ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.056411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878156cb-df06-4961-837f-4121b7f27ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.056838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878156cb-df06-4961-837f-4121b7f27ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.057045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878156cb-df06-4961-837f-4121b7f27ed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.071733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878156cb-df06-4961-837f-4121b7f27ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-878156cb-df06-4961-837f-4121b7f27ed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:04.078971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:04.079869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:04.080631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:04.087796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 57/107] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:04.087796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878156cb-df06-4961-837f-4121b7f27ed7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.110884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89474359-f29b-4ddc-ad5f-04b6fe2e7a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.111526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474359-f29b-4ddc-ad5f-04b6fe2e7a51 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.111807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474359-f29b-4ddc-ad5f-04b6fe2e7a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.112080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474359-f29b-4ddc-ad5f-04b6fe2e7a51 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.112763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89474359-f29b-4ddc-ad5f-04b6fe2e7a51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:04.113603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89474359-f29b-4ddc-ad5f-04b6fe2e7a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:04.115037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89474359-f29b-4ddc-ad5f-04b6fe2e7a51 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:04.121532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.126000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 51/108] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:04.127438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89474359-f29b-4ddc-ad5f-04b6fe2e7a51 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.216530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878156cb-df06-4961-837f-4121b7f27ed7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.243414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89474359-f29b-4ddc-ad5f-04b6fe2e7a51 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.254360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c1809-f2c2-49c3-8248-e198cb7daa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.255031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1809-f2c2-49c3-8248-e198cb7daa37 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.255310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1809-f2c2-49c3-8248-e198cb7daa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.255584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1809-f2c2-49c3-8248-e198cb7daa37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.256706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c1809-f2c2-49c3-8248-e198cb7daa37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:04.257563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.258565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c1809-f2c2-49c3-8248-e198cb7daa37 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:04.260579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 58/109] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:04.261289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c1809-f2c2-49c3-8248-e198cb7daa37 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.287421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859af56d-9cc9-45d7-b9c6-05afde3c96ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.288064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859af56d-9cc9-45d7-b9c6-05afde3c96ed None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.288342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859af56d-9cc9-45d7-b9c6-05afde3c96ed None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.288609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859af56d-9cc9-45d7-b9c6-05afde3c96ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.299328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859af56d-9cc9-45d7-b9c6-05afde3c96ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-859af56d-9cc9-45d7-b9c6-05afde3c96ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:04.304763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:04.305714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:04.306472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 52/110] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:04.307131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859af56d-9cc9-45d7-b9c6-05afde3c96ed None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.367203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.382609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c1809-f2c2-49c3-8248-e198cb7daa37 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.420287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859af56d-9cc9-45d7-b9c6-05afde3c96ed None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.422455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6724f-c22d-4bd0-a61a-d422deea78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.423437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6724f-c22d-4bd0-a61a-d422deea78e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.423722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6724f-c22d-4bd0-a61a-d422deea78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.424002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6724f-c22d-4bd0-a61a-d422deea78e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.424703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6724f-c22d-4bd0-a61a-d422deea78e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:04.425069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6724f-c22d-4bd0-a61a-d422deea78e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:04.426557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6724f-c22d-4bd0-a61a-d422deea78e6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:04.440567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 59/111] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:04.440567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e677-b013-41e9-aa91-5464b49bf11d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.440567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e677-b013-41e9-aa91-5464b49bf11d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.440567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e677-b013-41e9-aa91-5464b49bf11d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.440567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 60/112] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:04.444512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e677-b013-41e9-aa91-5464b49bf11d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.464167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c113161-ca0b-46c9-abcf-ab97b2bba915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.464820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c113161-ca0b-46c9-abcf-ab97b2bba915 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.465103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c113161-ca0b-46c9-abcf-ab97b2bba915 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.465441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c113161-ca0b-46c9-abcf-ab97b2bba915 None admin] PATH_INFO: `/v3/users/e92da4719e04489499a8bc2819786ff1` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.481593 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c113161-ca0b-46c9-abcf-ab97b2bba915 None admin] RBAC: Authorizing `identity:get_user(user_id=e92da4719e04489499a8bc2819786ff1)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:04.483104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c113161-ca0b-46c9-abcf-ab97b2bba915 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:04.484762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 53/113] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/users/e92da4719e04489499a8bc2819786ff1 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:04.485536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c113161-ca0b-46c9-abcf-ab97b2bba915 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.518109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.561662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e677-b013-41e9-aa91-5464b49bf11d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.593743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c113161-ca0b-46c9-abcf-ab97b2bba915 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.596354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb8e2f-4038-4eaa-bb2c-c033107f8a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.596974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8e2f-4038-4eaa-bb2c-c033107f8a62 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.597290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8e2f-4038-4eaa-bb2c-c033107f8a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.597568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8e2f-4038-4eaa-bb2c-c033107f8a62 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.598237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb8e2f-4038-4eaa-bb2c-c033107f8a62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:04.599750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb8e2f-4038-4eaa-bb2c-c033107f8a62 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:04.627692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 61/114] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:26:04 2022] POST /identity/v3/projects => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:04.629133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb8e2f-4038-4eaa-bb2c-c033107f8a62 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.630157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ee8b8-cdf2-4f58-9897-37d5c688eda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.630777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee8b8-cdf2-4f58-9897-37d5c688eda2 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.631093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee8b8-cdf2-4f58-9897-37d5c688eda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.631372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee8b8-cdf2-4f58-9897-37d5c688eda2 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.632065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee8b8-cdf2-4f58-9897-37d5c688eda2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:04.632170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.632413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee8b8-cdf2-4f58-9897-37d5c688eda2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:04.633801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee8b8-cdf2-4f58-9897-37d5c688eda2 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:04.661836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 54/115] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:04.661836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16807a-e57b-4918-b13f-b6ebe1c3bb40 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.661836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16807a-e57b-4918-b13f-b6ebe1c3bb40 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.661836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16807a-e57b-4918-b13f-b6ebe1c3bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.684276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-9d16807a-e57b-4918-b13f-b6ebe1c3bb40 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:04.685527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9d16807a-e57b-4918-b13f-b6ebe1c3bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:04.747488 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb8e2f-4038-4eaa-bb2c-c033107f8a62 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.771048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 55/116] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:04.771048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16807a-e57b-4918-b13f-b6ebe1c3bb40 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.805148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.810639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953c8bb-524e-4389-9819-7c6e55ab14ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.811377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953c8bb-524e-4389-9819-7c6e55ab14ed None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.811653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953c8bb-524e-4389-9819-7c6e55ab14ed None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.811935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953c8bb-524e-4389-9819-7c6e55ab14ed None admin] PATH_INFO: `/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.814335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953c8bb-524e-4389-9819-7c6e55ab14ed None admin] RBAC: Authorizing `identity:get_user(user_id=6a0674a0b804427ca12cbbcd5e4a20f5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:04.815924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953c8bb-524e-4389-9819-7c6e55ab14ed None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:04.818153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 62/117] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:04.821489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111fca2-fcc0-440b-8d06-d7c14072d315 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.821489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111fca2-fcc0-440b-8d06-d7c14072d315 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.821489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111fca2-fcc0-440b-8d06-d7c14072d315 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.821489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 63/118] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:04.822352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111fca2-fcc0-440b-8d06-d7c14072d315 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:04.900835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16807a-e57b-4918-b13f-b6ebe1c3bb40 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:04.921634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:04.946670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b858419-f667-4d56-8374-27418d9d7fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:04.947367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b858419-f667-4d56-8374-27418d9d7fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:04.947695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b858419-f667-4d56-8374-27418d9d7fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:04.947985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b858419-f667-4d56-8374-27418d9d7fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:04.969040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111fca2-fcc0-440b-8d06-d7c14072d315 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.016587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd3ae-eaec-4c32-87d3-e1be4776777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.017749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd3ae-eaec-4c32-87d3-e1be4776777a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.018033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd3ae-eaec-4c32-87d3-e1be4776777a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.018732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd3ae-eaec-4c32-87d3-e1be4776777a None admin] PATH_INFO: `/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.020814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbd3ae-eaec-4c32-87d3-e1be4776777a None admin] RBAC: Authorizing `identity:get_user(user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.022343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbd3ae-eaec-4c32-87d3-e1be4776777a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.025247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 64/119] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.026100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd3ae-eaec-4c32-87d3-e1be4776777a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.034538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b858419-f667-4d56-8374-27418d9d7fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.036201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b858419-f667-4d56-8374-27418d9d7fc5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.062293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.140969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd3ae-eaec-4c32-87d3-e1be4776777a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.155412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 56/120] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:05.155412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f32518-8067-4e1d-b3b9-5730b254bc1b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.155412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f32518-8067-4e1d-b3b9-5730b254bc1b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.155412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f32518-8067-4e1d-b3b9-5730b254bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.172594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c9f32518-8067-4e1d-b3b9-5730b254bc1b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:05.173785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c9f32518-8067-4e1d-b3b9-5730b254bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:05.182688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e161ea-a511-4e65-ba4f-0623fdaa128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.183695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e161ea-a511-4e65-ba4f-0623fdaa128a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.184117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e161ea-a511-4e65-ba4f-0623fdaa128a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.184690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e161ea-a511-4e65-ba4f-0623fdaa128a None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.185896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e161ea-a511-4e65-ba4f-0623fdaa128a None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.187568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e161ea-a511-4e65-ba4f-0623fdaa128a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.194463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 65/121] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.194463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e161ea-a511-4e65-ba4f-0623fdaa128a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.201604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.251630 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 57/122] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:05.255851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f32518-8067-4e1d-b3b9-5730b254bc1b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.323752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.331147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e161ea-a511-4e65-ba4f-0623fdaa128a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.375410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f32518-8067-4e1d-b3b9-5730b254bc1b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.379855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994235c7-913e-4d0d-9252-a49b31836f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.380736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994235c7-913e-4d0d-9252-a49b31836f21 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.381212 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994235c7-913e-4d0d-9252-a49b31836f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.381704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994235c7-913e-4d0d-9252-a49b31836f21 None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.383658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994235c7-913e-4d0d-9252-a49b31836f21 None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.385827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994235c7-913e-4d0d-9252-a49b31836f21 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.388503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 66/123] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.389906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994235c7-913e-4d0d-9252-a49b31836f21 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.419993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8d692-99bb-4ca9-ab4f-934065c05749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.421136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d692-99bb-4ca9-ab4f-934065c05749 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.421618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d692-99bb-4ca9-ab4f-934065c05749 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.422116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d692-99bb-4ca9-ab4f-934065c05749 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.439348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8d692-99bb-4ca9-ab4f-934065c05749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-17e8d692-99bb-4ca9-ab4f-934065c05749 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:05.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:05.446407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:05.447217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:05.448873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 58/124] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:05.449430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8d692-99bb-4ca9-ab4f-934065c05749 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.490778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.527558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994235c7-913e-4d0d-9252-a49b31836f21 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.562958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402b77-1612-488e-af6d-59308d99ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.563638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402b77-1612-488e-af6d-59308d99ab25 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.563928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402b77-1612-488e-af6d-59308d99ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.564201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402b77-1612-488e-af6d-59308d99ab25 None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.565323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402b77-1612-488e-af6d-59308d99ab25 None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.566845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402b77-1612-488e-af6d-59308d99ab25 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.568718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 67/125] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.569342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402b77-1612-488e-af6d-59308d99ab25 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.579711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8d692-99bb-4ca9-ab4f-934065c05749 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.595231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.624083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d5f7-ae0e-4ebf-9328-c5b8938094ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.624808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d5f7-ae0e-4ebf-9328-c5b8938094ba None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.625098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d5f7-ae0e-4ebf-9328-c5b8938094ba None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.625375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d5f7-ae0e-4ebf-9328-c5b8938094ba None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8/users/6a0674a0b804427ca12cbbcd5e4a20f5/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.627381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184d5f7-ae0e-4ebf-9328-c5b8938094ba None admin] RBAC: Authorizing `identity:create_grant(project_id=87d64932a5ad41f8b5467e542488e3c8, user_id=6a0674a0b804427ca12cbbcd5e4a20f5, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.628870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184d5f7-ae0e-4ebf-9328-c5b8938094ba None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.641968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 59/126] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:05 2022] PUT /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8/users/6a0674a0b804427ca12cbbcd5e4a20f5/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:05.654522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d5f7-ae0e-4ebf-9328-c5b8938094ba None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.683176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402b77-1612-488e-af6d-59308d99ab25 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.725530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eee848-eb26-4893-8a61-efb55df227aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.726358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eee848-eb26-4893-8a61-efb55df227aa None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.726737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eee848-eb26-4893-8a61-efb55df227aa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.727120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eee848-eb26-4893-8a61-efb55df227aa None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8/users/e0dfd0276ce04a8eb3f53b9cf0099b6f/roles/88da3cfff1d74296962f08ef7829479c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.730049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eee848-eb26-4893-8a61-efb55df227aa None admin] RBAC: Authorizing `identity:create_grant(project_id=87d64932a5ad41f8b5467e542488e3c8, user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f, role_id=88da3cfff1d74296962f08ef7829479c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.731856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eee848-eb26-4893-8a61-efb55df227aa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.755502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 68/127] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:05 2022] PUT /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8/users/e0dfd0276ce04a8eb3f53b9cf0099b6f/roles/88da3cfff1d74296962f08ef7829479c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:05.756615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eee848-eb26-4893-8a61-efb55df227aa None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.760008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.815008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d5f7-ae0e-4ebf-9328-c5b8938094ba None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.881041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a20b7-55e7-41b3-a6f9-717e82c9bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.882024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a20b7-55e7-41b3-a6f9-717e82c9bb9b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.882595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a20b7-55e7-41b3-a6f9-717e82c9bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.883123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a20b7-55e7-41b3-a6f9-717e82c9bb9b None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.884138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a20b7-55e7-41b3-a6f9-717e82c9bb9b None admin] RBAC: Adding query filter params (name=member) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:05.884666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a20b7-55e7-41b3-a6f9-717e82c9bb9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:05.886404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a20b7-55e7-41b3-a6f9-717e82c9bb9b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:05.894050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eee848-eb26-4893-8a61-efb55df227aa None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:05.900735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 60/128] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:05.902168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a20b7-55e7-41b3-a6f9-717e82c9bb9b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:05.959238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666a29-edbd-4314-9ecf-b3aa64c8ae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:05.960347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666a29-edbd-4314-9ecf-b3aa64c8ae33 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:05.960824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666a29-edbd-4314-9ecf-b3aa64c8ae33 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:05.961327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666a29-edbd-4314-9ecf-b3aa64c8ae33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:05.974439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41666a29-edbd-4314-9ecf-b3aa64c8ae33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:05.976517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-41666a29-edbd-4314-9ecf-b3aa64c8ae33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:05.980921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:05.981839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:05.982659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:05.985317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 69/129] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:05.986408 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666a29-edbd-4314-9ecf-b3aa64c8ae33 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.043487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a20b7-55e7-41b3-a6f9-717e82c9bb9b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.083425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.108188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e1976-6905-41ac-9eda-f4f4014a92d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.108800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e1976-6905-41ac-9eda-f4f4014a92d8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.109085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e1976-6905-41ac-9eda-f4f4014a92d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.109358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e1976-6905-41ac-9eda-f4f4014a92d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.110105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e1976-6905-41ac-9eda-f4f4014a92d8 None admin] RBAC: Adding query filter params (role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb, scope.project.id=87d64932a5ad41f8b5467e542488e3c8, user.id=e92da4719e04489499a8bc2819786ff1) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:06.110481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e1976-6905-41ac-9eda-f4f4014a92d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.112000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e1976-6905-41ac-9eda-f4f4014a92d8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.124619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 61/130] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/role_assignments?user.id=e92da4719e04489499a8bc2819786ff1&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:06.125266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e1976-6905-41ac-9eda-f4f4014a92d8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.165294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666a29-edbd-4314-9ecf-b3aa64c8ae33 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.254112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a82b7a-c6f8-4dba-bfc0-c6f8aa9cf0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.254773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a82b7a-c6f8-4dba-bfc0-c6f8aa9cf0cc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.255082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a82b7a-c6f8-4dba-bfc0-c6f8aa9cf0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.255358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a82b7a-c6f8-4dba-bfc0-c6f8aa9cf0cc None admin] PATH_INFO: `/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.256744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a82b7a-c6f8-4dba-bfc0-c6f8aa9cf0cc None admin] RBAC: Authorizing `identity:get_user(user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.258264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a82b7a-c6f8-4dba-bfc0-c6f8aa9cf0cc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.261628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 70/131] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:05 2022] GET /identity/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:06.265389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a82b7a-c6f8-4dba-bfc0-c6f8aa9cf0cc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.302375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.307870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e1976-6905-41ac-9eda-f4f4014a92d8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.387663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346f4b3-d194-4027-86dc-2a3bf8799ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.388299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346f4b3-d194-4027-86dc-2a3bf8799ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.388582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346f4b3-d194-4027-86dc-2a3bf8799ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.388856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346f4b3-d194-4027-86dc-2a3bf8799ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.389549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346f4b3-d194-4027-86dc-2a3bf8799ae9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:06.389856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346f4b3-d194-4027-86dc-2a3bf8799ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.391321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346f4b3-d194-4027-86dc-2a3bf8799ae9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.411010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 62/132] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:06.418857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346f4b3-d194-4027-86dc-2a3bf8799ae9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.482969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a82b7a-c6f8-4dba-bfc0-c6f8aa9cf0cc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.557089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.587006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bb8ef-3c58-4e84-ab1f-5ddf45a66a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.587006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bb8ef-3c58-4e84-ab1f-5ddf45a66a7d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.587006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bb8ef-3c58-4e84-ab1f-5ddf45a66a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.587006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bb8ef-3c58-4e84-ab1f-5ddf45a66a7d None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.587359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bb8ef-3c58-4e84-ab1f-5ddf45a66a7d None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.587649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bb8ef-3c58-4e84-ab1f-5ddf45a66a7d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.589510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 71/133] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:06.595110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bb8ef-3c58-4e84-ab1f-5ddf45a66a7d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.615126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346f4b3-d194-4027-86dc-2a3bf8799ae9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.687814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c3e99-68a6-497c-8a43-9fe653942ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.688397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c3e99-68a6-497c-8a43-9fe653942ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.688693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c3e99-68a6-497c-8a43-9fe653942ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.688979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c3e99-68a6-497c-8a43-9fe653942ca9 None admin] PATH_INFO: `/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.690246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c3e99-68a6-497c-8a43-9fe653942ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.691784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c3e99-68a6-497c-8a43-9fe653942ca9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.693763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 63/134] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:06.706622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c3e99-68a6-497c-8a43-9fe653942ca9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:06.761242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:06.889154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bb8ef-3c58-4e84-ab1f-5ddf45a66a7d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.890006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c3e99-68a6-497c-8a43-9fe653942ca9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:06.960552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d863c6-f5af-406f-b3f7-2971f8124c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:06.961336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d863c6-f5af-406f-b3f7-2971f8124c9c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:06.961633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d863c6-f5af-406f-b3f7-2971f8124c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:06.961911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d863c6-f5af-406f-b3f7-2971f8124c9c None admin] PATH_INFO: `/v3/projects/1ccbc6d2484f41b584482f99f6752e71` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:06.963145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d863c6-f5af-406f-b3f7-2971f8124c9c None admin] RBAC: Authorizing `identity:get_project(project_id=1ccbc6d2484f41b584482f99f6752e71)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:06.964778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d863c6-f5af-406f-b3f7-2971f8124c9c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:06.966757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 64/135] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:06 2022] GET /identity/v3/projects/1ccbc6d2484f41b584482f99f6752e71 => generated 312 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:06.974790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d863c6-f5af-406f-b3f7-2971f8124c9c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.004263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f26f3-f835-48f9-a634-d4a652939b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.004963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f26f3-f835-48f9-a634-d4a652939b5c None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.005254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f26f3-f835-48f9-a634-d4a652939b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.005537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f26f3-f835-48f9-a634-d4a652939b5c None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8/users/e0dfd0276ce04a8eb3f53b9cf0099b6f/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.007639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f26f3-f835-48f9-a634-d4a652939b5c None admin] RBAC: Authorizing `identity:create_grant(project_id=87d64932a5ad41f8b5467e542488e3c8, user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.009128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f26f3-f835-48f9-a634-d4a652939b5c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:07.049509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 72/136] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:06 2022] PUT /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8/users/e0dfd0276ce04a8eb3f53b9cf0099b6f/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:07.148562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ec0a9-ae6e-4197-863a-231ef0c443da None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.149754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ec0a9-ae6e-4197-863a-231ef0c443da None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.150232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ec0a9-ae6e-4197-863a-231ef0c443da None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.152283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 73/137] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:07.155320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:07.160952 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d863c6-f5af-406f-b3f7-2971f8124c9c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.161683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db929d-7318-46b2-b979-d24268607f0f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.162172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db929d-7318-46b2-b979-d24268607f0f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.162826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db929d-7318-46b2-b979-d24268607f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.202552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c2d8-7d16-413a-a589-3233766b2005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.203271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c2d8-7d16-413a-a589-3233766b2005 None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.203560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c2d8-7d16-413a-a589-3233766b2005 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.203843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c2d8-7d16-413a-a589-3233766b2005 None admin] PATH_INFO: `/v3/projects/1ccbc6d2484f41b584482f99f6752e71/users/e0dfd0276ce04a8eb3f53b9cf0099b6f/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.205807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466c2d8-7d16-413a-a589-3233766b2005 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ccbc6d2484f41b584482f99f6752e71, user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.215030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466c2d8-7d16-413a-a589-3233766b2005 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:07.216475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-93db929d-7318-46b2-b979-d24268607f0f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:07.217923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-93db929d-7318-46b2-b979-d24268607f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:07.226964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 65/138] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:06 2022] PUT /identity/v3/projects/1ccbc6d2484f41b584482f99f6752e71/users/e0dfd0276ce04a8eb3f53b9cf0099b6f/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:07.317359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:07.338320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 74/139] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:07.631279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c2d8-7d16-413a-a589-3233766b2005 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.756773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c2d8-7d16-413a-a589-3233766b2005 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.804912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ca402-a8ef-432d-9271-a85e8dd3d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.805575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ca402-a8ef-432d-9271-a85e8dd3d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.805922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ca402-a8ef-432d-9271-a85e8dd3d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.806200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ca402-a8ef-432d-9271-a85e8dd3d2d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.807405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ca402-a8ef-432d-9271-a85e8dd3d2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.808878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ca402-a8ef-432d-9271-a85e8dd3d2d8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:07.810788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 66/140] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:07.816852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db929d-7318-46b2-b979-d24268607f0f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:07.944628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db929d-7318-46b2-b979-d24268607f0f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:07.995206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912b747-901f-4124-96f2-55f08ba3fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:07.995824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912b747-901f-4124-96f2-55f08ba3fd31 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:07.996104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912b747-901f-4124-96f2-55f08ba3fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:07.996382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912b747-901f-4124-96f2-55f08ba3fd31 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:07.997031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912b747-901f-4124-96f2-55f08ba3fd31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:07.998540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912b747-901f-4124-96f2-55f08ba3fd31 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:08.031969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 75/141] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:07 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:08.405653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86482b7a-9ae0-4751-ae62-f03169f53265 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:08.406711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86482b7a-9ae0-4751-ae62-f03169f53265 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:08.407241 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86482b7a-9ae0-4751-ae62-f03169f53265 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:08.408848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 67/142] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:08.416969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368108e8-439a-4055-baa4-f4e3fa54d75b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:08.417881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368108e8-439a-4055-baa4-f4e3fa54d75b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:08.418389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368108e8-439a-4055-baa4-f4e3fa54d75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:08.437513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-368108e8-439a-4055-baa4-f4e3fa54d75b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:08.439071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-368108e8-439a-4055-baa4-f4e3fa54d75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:08.507389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:08.540243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 76/143] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:08.569794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae5aae-362b-4706-96ee-4d943cbf85fd None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:08.570127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae5aae-362b-4706-96ee-4d943cbf85fd None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:08.570361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae5aae-362b-4706-96ee-4d943cbf85fd None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:08.571912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 68/144] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:08.577324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67401ac-758c-4d64-a9ca-fe00faaf81f9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:08.577616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67401ac-758c-4d64-a9ca-fe00faaf81f9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:08.577899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67401ac-758c-4d64-a9ca-fe00faaf81f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:08.606113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e67401ac-758c-4d64-a9ca-fe00faaf81f9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:08.607432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e67401ac-758c-4d64-a9ca-fe00faaf81f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:08.682758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 77/145] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:09.005884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047363c9-3c2e-4662-9e83-f237125a2ecb None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.006101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047363c9-3c2e-4662-9e83-f237125a2ecb None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.006386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047363c9-3c2e-4662-9e83-f237125a2ecb None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.007770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 69/146] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:09.012953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3124f2-28b4-4fc3-b1cc-87b7ea236866 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.013239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3124f2-28b4-4fc3-b1cc-87b7ea236866 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.013515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3124f2-28b4-4fc3-b1cc-87b7ea236866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.036578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4e3124f2-28b4-4fc3-b1cc-87b7ea236866 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:09.037841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4e3124f2-28b4-4fc3-b1cc-87b7ea236866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:09.038070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047363c9-3c2e-4662-9e83-f237125a2ecb None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.086293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:09.163686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 78/147] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:09.164720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3124f2-28b4-4fc3-b1cc-87b7ea236866 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.213994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:09.231987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047363c9-3c2e-4662-9e83-f237125a2ecb None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.309241 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38486ac-8f31-42fe-b313-1b43cbd7a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.309894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38486ac-8f31-42fe-b313-1b43cbd7a321 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.310177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38486ac-8f31-42fe-b313-1b43cbd7a321 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.310448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38486ac-8f31-42fe-b313-1b43cbd7a321 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.330992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38486ac-8f31-42fe-b313-1b43cbd7a321 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:09.337506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3124f2-28b4-4fc3-b1cc-87b7ea236866 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-a38486ac-8f31-42fe-b313-1b43cbd7a321 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:09.340098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:09.340933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:09.341683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 70/148] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:09.353301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38486ac-8f31-42fe-b313-1b43cbd7a321 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.416677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb58aa4-3d0d-4757-b1e4-b18c93df416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.417354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb58aa4-3d0d-4757-b1e4-b18c93df416e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.417881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb58aa4-3d0d-4757-b1e4-b18c93df416e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.417881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb58aa4-3d0d-4757-b1e4-b18c93df416e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.452006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb58aa4-3d0d-4757-b1e4-b18c93df416e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-5eb58aa4-3d0d-4757-b1e4-b18c93df416e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:09.457542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:09.458419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:09.459188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 79/149] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:09.472593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb58aa4-3d0d-4757-b1e4-b18c93df416e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.480198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:09.499638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38486ac-8f31-42fe-b313-1b43cbd7a321 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.539681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e721a7f-5144-42b4-a3fe-cadd2d7eabdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.540304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e721a7f-5144-42b4-a3fe-cadd2d7eabdd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.540583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e721a7f-5144-42b4-a3fe-cadd2d7eabdd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.540855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e721a7f-5144-42b4-a3fe-cadd2d7eabdd None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.541543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e721a7f-5144-42b4-a3fe-cadd2d7eabdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:09.541852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e721a7f-5144-42b4-a3fe-cadd2d7eabdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:09.543292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e721a7f-5144-42b4-a3fe-cadd2d7eabdd None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:09.554506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 71/150] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:09.560091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e721a7f-5144-42b4-a3fe-cadd2d7eabdd None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.666962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:09.674519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb58aa4-3d0d-4757-b1e4-b18c93df416e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.675745 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e721a7f-5144-42b4-a3fe-cadd2d7eabdd None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.712998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04220f3-2755-4360-ac53-3944dc126416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.713653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04220f3-2755-4360-ac53-3944dc126416 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.713931 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04220f3-2755-4360-ac53-3944dc126416 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.714281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04220f3-2755-4360-ac53-3944dc126416 None admin] PATH_INFO: `/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.718485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04220f3-2755-4360-ac53-3944dc126416 None admin] RBAC: Authorizing `identity:get_user(user_id=6a0674a0b804427ca12cbbcd5e4a20f5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:09.718485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04220f3-2755-4360-ac53-3944dc126416 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:09.718710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 72/151] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/users/6a0674a0b804427ca12cbbcd5e4a20f5 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:09.728319 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04220f3-2755-4360-ac53-3944dc126416 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.739665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bcae1-7774-4e01-bcca-dd93ab7c4e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.740700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcae1-7774-4e01-bcca-dd93ab7c4e34 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.741200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcae1-7774-4e01-bcca-dd93ab7c4e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.741669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcae1-7774-4e01-bcca-dd93ab7c4e34 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.742562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcae1-7774-4e01-bcca-dd93ab7c4e34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:09.743098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcae1-7774-4e01-bcca-dd93ab7c4e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:09.744718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcae1-7774-4e01-bcca-dd93ab7c4e34 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:09.746614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:09.754790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 80/152] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:09.760252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bcae1-7774-4e01-bcca-dd93ab7c4e34 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:09.864560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04220f3-2755-4360-ac53-3944dc126416 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.911185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56dde-d151-4183-b07b-606263b1bfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.912074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56dde-d151-4183-b07b-606263b1bfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.912496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56dde-d151-4183-b07b-606263b1bfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.913125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56dde-d151-4183-b07b-606263b1bfe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:09.930700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bcae1-7774-4e01-bcca-dd93ab7c4e34 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:09.996574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd850cc-facf-45d7-9f7a-a5d8a702e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:09.997461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd850cc-facf-45d7-9f7a-a5d8a702e63e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:09.997882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd850cc-facf-45d7-9f7a-a5d8a702e63e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:09.998296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd850cc-facf-45d7-9f7a-a5d8a702e63e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.021649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd850cc-facf-45d7-9f7a-a5d8a702e63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3dd850cc-facf-45d7-9f7a-a5d8a702e63e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:10.027261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:10.028255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:10.029209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:10.032092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 81/153] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:10.035043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd850cc-facf-45d7-9f7a-a5d8a702e63e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.052393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56dde-d151-4183-b07b-606263b1bfe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.054092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56dde-d151-4183-b07b-606263b1bfe3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:10.076647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.079277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.230021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd850cc-facf-45d7-9f7a-a5d8a702e63e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.276953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 73/154] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:10.277796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7ded-3dc5-441a-a8b1-40c850c91560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.278402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56dde-d151-4183-b07b-606263b1bfe3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.278507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7ded-3dc5-441a-a8b1-40c850c91560 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.278711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7ded-3dc5-441a-a8b1-40c850c91560 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.279179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7ded-3dc5-441a-a8b1-40c850c91560 None admin] PATH_INFO: `/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.282083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7ded-3dc5-441a-a8b1-40c850c91560 None admin] RBAC: Authorizing `identity:get_user(user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.283715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7ded-3dc5-441a-a8b1-40c850c91560 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:10.285486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 82/155] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:10.291302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8b351-502e-44cc-93fd-34f03b003052 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.291780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8b351-502e-44cc-93fd-34f03b003052 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.292197 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8b351-502e-44cc-93fd-34f03b003052 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.293598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 83/156] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:10.301164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f4de-3c91-4d8e-9170-6ab5c67f985c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.302335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f4de-3c91-4d8e-9170-6ab5c67f985c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.303256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6f4de-3c91-4d8e-9170-6ab5c67f985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.340053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d7d6f4de-3c91-4d8e-9170-6ab5c67f985c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:10.341490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d7d6f4de-3c91-4d8e-9170-6ab5c67f985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:10.479995 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 84/157] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:10.487200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f4de-3c91-4d8e-9170-6ab5c67f985c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.527306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.545776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56dde-d151-4183-b07b-606263b1bfe3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.576884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.631651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725db46-88f0-47a7-84ab-3ea76e8c6729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.632277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725db46-88f0-47a7-84ab-3ea76e8c6729 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.632567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725db46-88f0-47a7-84ab-3ea76e8c6729 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.632853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725db46-88f0-47a7-84ab-3ea76e8c6729 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.633919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725db46-88f0-47a7-84ab-3ea76e8c6729 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:10.634241 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725db46-88f0-47a7-84ab-3ea76e8c6729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.635769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725db46-88f0-47a7-84ab-3ea76e8c6729 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:10.649094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 74/158] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:10.650128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725db46-88f0-47a7-84ab-3ea76e8c6729 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.707239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6f4de-3c91-4d8e-9170-6ab5c67f985c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.771773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570f6f9-e97c-4939-81f5-710f607db449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.772648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f6f9-e97c-4939-81f5-710f607db449 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.773067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f6f9-e97c-4939-81f5-710f607db449 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570f6f9-e97c-4939-81f5-710f607db449 None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.774816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570f6f9-e97c-4939-81f5-710f607db449 None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.782504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570f6f9-e97c-4939-81f5-710f607db449 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:10.785961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 85/159] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:10.800443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e5ba9-c0d1-46b3-b8ea-ee5f34eb4174 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.801136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e5ba9-c0d1-46b3-b8ea-ee5f34eb4174 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.801559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e5ba9-c0d1-46b3-b8ea-ee5f34eb4174 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.804082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 86/160] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:10.805106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e5ba9-c0d1-46b3-b8ea-ee5f34eb4174 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:10.820229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725db46-88f0-47a7-84ab-3ea76e8c6729 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:10.867982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774fe41-84ac-49af-a9fb-9b49fb807fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:10.868739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774fe41-84ac-49af-a9fb-9b49fb807fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:10.869027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774fe41-84ac-49af-a9fb-9b49fb807fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:10.869303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774fe41-84ac-49af-a9fb-9b49fb807fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:10.964360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:10.978958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774fe41-84ac-49af-a9fb-9b49fb807fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:10.980538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774fe41-84ac-49af-a9fb-9b49fb807fa7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.007345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:11.029917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e5ba9-c0d1-46b3-b8ea-ee5f34eb4174 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.093778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 75/161] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:11.096196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774fe41-84ac-49af-a9fb-9b49fb807fa7 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.158896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0800479-5711-4894-8163-00d1445aea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.160207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0800479-5711-4894-8163-00d1445aea6c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.160548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0800479-5711-4894-8163-00d1445aea6c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.160972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0800479-5711-4894-8163-00d1445aea6c None admin] PATH_INFO: `/v3/users/e92da4719e04489499a8bc2819786ff1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.162289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0800479-5711-4894-8163-00d1445aea6c None admin] RBAC: Authorizing `identity:get_user(user_id=e92da4719e04489499a8bc2819786ff1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:11.163928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0800479-5711-4894-8163-00d1445aea6c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.171362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 87/162] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:10 2022] GET /identity/v3/users/e92da4719e04489499a8bc2819786ff1 => generated 289 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:11.172393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0800479-5711-4894-8163-00d1445aea6c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.195320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:11.216870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774fe41-84ac-49af-a9fb-9b49fb807fa7 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.263190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0942af-854d-4be3-92a2-b3ea5098fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.264198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0942af-854d-4be3-92a2-b3ea5098fb27 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.264758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0942af-854d-4be3-92a2-b3ea5098fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.265226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0942af-854d-4be3-92a2-b3ea5098fb27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.266174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0942af-854d-4be3-92a2-b3ea5098fb27 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=87d64932a5ad41f8b5467e542488e3c8, user.id=6a0674a0b804427ca12cbbcd5e4a20f5) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:11.266690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0942af-854d-4be3-92a2-b3ea5098fb27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:11.269679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0942af-854d-4be3-92a2-b3ea5098fb27 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.277252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 76/163] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/role_assignments?user.id=6a0674a0b804427ca12cbbcd5e4a20f5&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=609b1a993a394f0e900e17edccebaea5 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:11.278874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc87579-23d0-4f4a-8b42-6facecd49a23 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.279430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc87579-23d0-4f4a-8b42-6facecd49a23 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.279998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc87579-23d0-4f4a-8b42-6facecd49a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.305810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-3bc87579-23d0-4f4a-8b42-6facecd49a23 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:11.307618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3bc87579-23d0-4f4a-8b42-6facecd49a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:11.392698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 77/164] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:11.394602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc87579-23d0-4f4a-8b42-6facecd49a23 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.477333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:11.513963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc87579-23d0-4f4a-8b42-6facecd49a23 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.558670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0800479-5711-4894-8163-00d1445aea6c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.568694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6571-55ee-44c4-845a-e6f8f8812f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.570007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6571-55ee-44c4-845a-e6f8f8812f65 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.570480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6571-55ee-44c4-845a-e6f8f8812f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.571536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6571-55ee-44c4-845a-e6f8f8812f65 None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.575774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d6571-55ee-44c4-845a-e6f8f8812f65 None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:11.578137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d6571-55ee-44c4-845a-e6f8f8812f65 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.580106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 78/165] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:11.581164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6571-55ee-44c4-845a-e6f8f8812f65 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.715012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241c0d-8af0-4c16-9991-6871eacde8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.715631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241c0d-8af0-4c16-9991-6871eacde8cc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.715909 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241c0d-8af0-4c16-9991-6871eacde8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.716182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241c0d-8af0-4c16-9991-6871eacde8cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.732665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6571-55ee-44c4-845a-e6f8f8812f65 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.770961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85241c0d-8af0-4c16-9991-6871eacde8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-85241c0d-8af0-4c16-9991-6871eacde8cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:11.773503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:11.774347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 88/166] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 603 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:11.775750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241c0d-8af0-4c16-9991-6871eacde8cc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.787793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238df9-d165-4043-985d-67650f09c08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.788769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238df9-d165-4043-985d-67650f09c08b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.789240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238df9-d165-4043-985d-67650f09c08b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.789724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238df9-d165-4043-985d-67650f09c08b None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.794717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20238df9-d165-4043-985d-67650f09c08b None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:11.797053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20238df9-d165-4043-985d-67650f09c08b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.798012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:11.799780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 79/167] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:11.801074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238df9-d165-4043-985d-67650f09c08b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.815391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:11.918640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238df9-d165-4043-985d-67650f09c08b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.942509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241c0d-8af0-4c16-9991-6871eacde8cc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:11.957047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1277-12cd-47fc-b087-68a755985573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.957658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1277-12cd-47fc-b087-68a755985573 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.957937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1277-12cd-47fc-b087-68a755985573 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.958208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1277-12cd-47fc-b087-68a755985573 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.958880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d1277-12cd-47fc-b087-68a755985573 None admin] RBAC: Adding query filter params (name=member) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:11.959323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d1277-12cd-47fc-b087-68a755985573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:11.960695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d1277-12cd-47fc-b087-68a755985573 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.970351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 80/168] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:11.975303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1277-12cd-47fc-b087-68a755985573 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:11.987732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30a5ed-9424-488a-95ff-2874528ed490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:11.988350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30a5ed-9424-488a-95ff-2874528ed490 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:11.988629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30a5ed-9424-488a-95ff-2874528ed490 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:11.988950 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30a5ed-9424-488a-95ff-2874528ed490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:11.989691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30a5ed-9424-488a-95ff-2874528ed490 None admin] RBAC: Adding query filter params (role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=87d64932a5ad41f8b5467e542488e3c8, user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:11.990000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30a5ed-9424-488a-95ff-2874528ed490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:11.991654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30a5ed-9424-488a-95ff-2874528ed490 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:11.997964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 89/169] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/role_assignments?user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=88da3cfff1d74296962f08ef7829479c => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:11.998628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30a5ed-9424-488a-95ff-2874528ed490 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.051299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.083161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.092667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1277-12cd-47fc-b087-68a755985573 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.113051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30a5ed-9424-488a-95ff-2874528ed490 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.135625 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cc67a-98b3-4926-a310-76732228956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.136280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cc67a-98b3-4926-a310-76732228956f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.136558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cc67a-98b3-4926-a310-76732228956f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.136826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cc67a-98b3-4926-a310-76732228956f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.151097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cc67a-98b3-4926-a310-76732228956f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:12.154584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fce197-13be-4de1-a4b8-75a8534a556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.155289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce197-13be-4de1-a4b8-75a8534a556d None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.155572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce197-13be-4de1-a4b8-75a8534a556d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.155849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce197-13be-4de1-a4b8-75a8534a556d None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8/users/e92da4719e04489499a8bc2819786ff1/roles/d9a919d50d054dcb8a6af1fcf0cfdbdb` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-8a6cc67a-98b3-4926-a310-76732228956f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:12.156429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:12.158690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:12.161143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 81/170] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:12.162744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fce197-13be-4de1-a4b8-75a8534a556d None admin] RBAC: Authorizing `identity:create_grant(project_id=87d64932a5ad41f8b5467e542488e3c8, user_id=e92da4719e04489499a8bc2819786ff1, role_id=d9a919d50d054dcb8a6af1fcf0cfdbdb)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:12.162890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cc67a-98b3-4926-a310-76732228956f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.169407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fce197-13be-4de1-a4b8-75a8534a556d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:12.192960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 90/171] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:11 2022] PUT /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8/users/e92da4719e04489499a8bc2819786ff1/roles/d9a919d50d054dcb8a6af1fcf0cfdbdb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:12.194696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1182222-200b-4387-aac0-c1818db554b2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.194900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1182222-200b-4387-aac0-c1818db554b2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.195267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1182222-200b-4387-aac0-c1818db554b2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.196943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 91/172] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:12.203796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1182222-200b-4387-aac0-c1818db554b2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.293073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cc67a-98b3-4926-a310-76732228956f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.326304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.342244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf25827-ec0e-4ad3-b70a-7be969bb6e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.342815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf25827-ec0e-4ad3-b70a-7be969bb6e57 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.343132 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf25827-ec0e-4ad3-b70a-7be969bb6e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.343392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf25827-ec0e-4ad3-b70a-7be969bb6e57 None admin] PATH_INFO: `/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.344622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf25827-ec0e-4ad3-b70a-7be969bb6e57 None admin] RBAC: Authorizing `identity:get_user(user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:12.347532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf25827-ec0e-4ad3-b70a-7be969bb6e57 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:12.349294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 82/173] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:12.355313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43839512-767d-4487-9c08-41bace0c8792 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.355604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43839512-767d-4487-9c08-41bace0c8792 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.355859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43839512-767d-4487-9c08-41bace0c8792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.388112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-43839512-767d-4487-9c08-41bace0c8792 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:12.389348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-43839512-767d-4487-9c08-41bace0c8792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:12.409486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1182222-200b-4387-aac0-c1818db554b2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.465339 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11f7cd-c7f2-4ac2-b795-ea000ac98edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.466509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11f7cd-c7f2-4ac2-b795-ea000ac98edb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.466509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11f7cd-c7f2-4ac2-b795-ea000ac98edb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.466694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11f7cd-c7f2-4ac2-b795-ea000ac98edb None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.467356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11f7cd-c7f2-4ac2-b795-ea000ac98edb None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:12.467657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11f7cd-c7f2-4ac2-b795-ea000ac98edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:12.469753 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11f7cd-c7f2-4ac2-b795-ea000ac98edb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:12.472774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.484112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 92/174] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:12.484987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11f7cd-c7f2-4ac2-b795-ea000ac98edb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.511878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 83/175] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:12.513851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43839512-767d-4487-9c08-41bace0c8792 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.664660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11f7cd-c7f2-4ac2-b795-ea000ac98edb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.687472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43839512-767d-4487-9c08-41bace0c8792 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.729722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eac55d-740e-4998-b015-578de2fddbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.730701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac55d-740e-4998-b015-578de2fddbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.731409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac55d-740e-4998-b015-578de2fddbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.732581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac55d-740e-4998-b015-578de2fddbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.736309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.754587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656905b5-9986-42c0-8872-108484871fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.755642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656905b5-9986-42c0-8872-108484871fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.756137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656905b5-9986-42c0-8872-108484871fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.756651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656905b5-9986-42c0-8872-108484871fa6 None admin] PATH_INFO: `/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.758095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656905b5-9986-42c0-8872-108484871fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=e0dfd0276ce04a8eb3f53b9cf0099b6f)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:12.761134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656905b5-9986-42c0-8872-108484871fa6 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:12.763400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 84/176] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/users/e0dfd0276ce04a8eb3f53b9cf0099b6f => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:12.765621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139a71-b802-441d-a479-573670655e1a None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.766308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139a71-b802-441d-a479-573670655e1a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.768559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139a71-b802-441d-a479-573670655e1a None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.769920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 85/177] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:12.778961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5139a71-b802-441d-a479-573670655e1a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:12.859750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:12.868634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eac55d-740e-4998-b015-578de2fddbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:12.870295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eac55d-740e-4998-b015-578de2fddbb2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:12.936599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5139a71-b802-441d-a479-573670655e1a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:12.981676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c8d12-ca91-45a7-9709-b20fda6bd92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:12.982308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c8d12-ca91-45a7-9709-b20fda6bd92f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.982579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c8d12-ca91-45a7-9709-b20fda6bd92f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.982853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c8d12-ca91-45a7-9709-b20fda6bd92f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:12.989901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 93/178] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:12.991467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76b24e-70e5-42d3-8b4e-78cf3d00740a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:12.991981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76b24e-70e5-42d3-8b4e-78cf3d00740a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:12.992509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76b24e-70e5-42d3-8b4e-78cf3d00740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.014286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6d76b24e-70e5-42d3-8b4e-78cf3d00740a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:13.015509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6d76b24e-70e5-42d3-8b4e-78cf3d00740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:13.063219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.071755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c8d12-ca91-45a7-9709-b20fda6bd92f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.073667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c8d12-ca91-45a7-9709-b20fda6bd92f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.098739 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 94/179] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:13.100112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c481b-a71e-4c63-8dd5-56f111da4be7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.100403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c481b-a71e-4c63-8dd5-56f111da4be7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.100676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c481b-a71e-4c63-8dd5-56f111da4be7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.106470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 95/180] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:13.106470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c481b-a71e-4c63-8dd5-56f111da4be7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.137406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.193871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 86/181] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:13.194747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c8d12-ca91-45a7-9709-b20fda6bd92f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.225014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c481b-a71e-4c63-8dd5-56f111da4be7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.267734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d94e9-9c60-427c-831d-f1f014bd42de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.268848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d94e9-9c60-427c-831d-f1f014bd42de None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.269431 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d94e9-9c60-427c-831d-f1f014bd42de None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.270005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d94e9-9c60-427c-831d-f1f014bd42de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.281990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d94e9-9c60-427c-831d-f1f014bd42de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9a4d94e9-9c60-427c-831d-f1f014bd42de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:13.287763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:13.288724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:13.289535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:13.292127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 96/182] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:13.293755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889d82-17f2-48b1-8927-ffae8df12b3c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.294255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889d82-17f2-48b1-8927-ffae8df12b3c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.294742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889d82-17f2-48b1-8927-ffae8df12b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.299255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.307815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c8d12-ca91-45a7-9709-b20fda6bd92f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.318287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f4889d82-17f2-48b1-8927-ffae8df12b3c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:13.319840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f4889d82-17f2-48b1-8927-ffae8df12b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:13.348477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21c7f7-b938-4f4b-a55d-0d2b99e2e31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.349806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21c7f7-b938-4f4b-a55d-0d2b99e2e31e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.350384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21c7f7-b938-4f4b-a55d-0d2b99e2e31e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.350766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21c7f7-b938-4f4b-a55d-0d2b99e2e31e None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.352057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21c7f7-b938-4f4b-a55d-0d2b99e2e31e None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.353830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21c7f7-b938-4f4b-a55d-0d2b99e2e31e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.355847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 87/183] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:13.362609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21c7f7-b938-4f4b-a55d-0d2b99e2e31e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.404135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 97/184] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:13.409503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4889d82-17f2-48b1-8927-ffae8df12b3c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.429512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.499322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21c7f7-b938-4f4b-a55d-0d2b99e2e31e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.531500 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4889d82-17f2-48b1-8927-ffae8df12b3c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.542020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaee9e-3ee8-4215-8ea8-bdb18c72adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.542607 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaee9e-3ee8-4215-8ea8-bdb18c72adee None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.543025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaee9e-3ee8-4215-8ea8-bdb18c72adee None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.543396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaee9e-3ee8-4215-8ea8-bdb18c72adee None admin] PATH_INFO: `/v3/projects/1ccbc6d2484f41b584482f99f6752e71` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.545004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaee9e-3ee8-4215-8ea8-bdb18c72adee None admin] RBAC: Authorizing `identity:get_project(project_id=1ccbc6d2484f41b584482f99f6752e71)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.546618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaee9e-3ee8-4215-8ea8-bdb18c72adee None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.548633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 88/185] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/projects/1ccbc6d2484f41b584482f99f6752e71 => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:13.549506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaee9e-3ee8-4215-8ea8-bdb18c72adee None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.578458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65f8ec-87a3-4ee9-803a-3936926f56de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.579402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f8ec-87a3-4ee9-803a-3936926f56de None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.580097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f8ec-87a3-4ee9-803a-3936926f56de None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.580519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f8ec-87a3-4ee9-803a-3936926f56de None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.581555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65f8ec-87a3-4ee9-803a-3936926f56de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:13.582004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65f8ec-87a3-4ee9-803a-3936926f56de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.584045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65f8ec-87a3-4ee9-803a-3936926f56de None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.589254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.595755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 98/186] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:13.597360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65f8ec-87a3-4ee9-803a-3936926f56de None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.694374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaee9e-3ee8-4215-8ea8-bdb18c72adee None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.703002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.735561 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65f8ec-87a3-4ee9-803a-3936926f56de None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.736581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4115a-ec4a-44e7-be2e-71ca125d732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.737208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4115a-ec4a-44e7-be2e-71ca125d732e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.738080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4115a-ec4a-44e7-be2e-71ca125d732e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.738966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4115a-ec4a-44e7-be2e-71ca125d732e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.739179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4115a-ec4a-44e7-be2e-71ca125d732e None admin] RBAC: Adding query filter params (role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=87d64932a5ad41f8b5467e542488e3c8, user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:13.739446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4115a-ec4a-44e7-be2e-71ca125d732e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.740901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4115a-ec4a-44e7-be2e-71ca125d732e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.755173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 89/187] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/role_assignments?user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=79bef6f5048d441d883bb015c7887170 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:13.755173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4115a-ec4a-44e7-be2e-71ca125d732e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.789629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792559f-a326-4090-b875-6db145bf922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.790404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792559f-a326-4090-b875-6db145bf922b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.790741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792559f-a326-4090-b875-6db145bf922b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.791051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792559f-a326-4090-b875-6db145bf922b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.808806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792559f-a326-4090-b875-6db145bf922b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a792559f-a326-4090-b875-6db145bf922b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:13.813955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:13.814883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:13.815728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:13.820281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 99/188] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:13.821397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792559f-a326-4090-b875-6db145bf922b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:13.896938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:13.907998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4115a-ec4a-44e7-be2e-71ca125d732e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.954827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa126d-62bc-48d0-9318-8b9ad7fb919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:13.956761 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa126d-62bc-48d0-9318-8b9ad7fb919b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:13.957040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa126d-62bc-48d0-9318-8b9ad7fb919b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:13.957308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa126d-62bc-48d0-9318-8b9ad7fb919b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:13.958349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa126d-62bc-48d0-9318-8b9ad7fb919b None admin] RBAC: Adding query filter params (role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=1ccbc6d2484f41b584482f99f6752e71, user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:13.958659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa126d-62bc-48d0-9318-8b9ad7fb919b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:13.960336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa126d-62bc-48d0-9318-8b9ad7fb919b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:13.963849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792559f-a326-4090-b875-6db145bf922b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:13.968462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 90/189] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/role_assignments?user.id=e0dfd0276ce04a8eb3f53b9cf0099b6f&scope.project.id=1ccbc6d2484f41b584482f99f6752e71&role.id=79bef6f5048d441d883bb015c7887170 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:13.969458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa126d-62bc-48d0-9318-8b9ad7fb919b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.021230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612417-3307-48e1-a1e8-8a38214e7423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.021927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612417-3307-48e1-a1e8-8a38214e7423 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.022176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612417-3307-48e1-a1e8-8a38214e7423 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.022441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612417-3307-48e1-a1e8-8a38214e7423 None admin] PATH_INFO: `/v3/users/94d3be25cb5f45609e708d7ebda1599c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.039320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.042624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98612417-3307-48e1-a1e8-8a38214e7423 None admin] RBAC: Authorizing `identity:get_user(user_id=94d3be25cb5f45609e708d7ebda1599c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.046376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98612417-3307-48e1-a1e8-8a38214e7423 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.050231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 100/190] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/users/94d3be25cb5f45609e708d7ebda1599c => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:14.050877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612417-3307-48e1-a1e8-8a38214e7423 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.118372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa126d-62bc-48d0-9318-8b9ad7fb919b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.161660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e56b02-2bcd-453a-ae29-15769f78b007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.162720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e56b02-2bcd-453a-ae29-15769f78b007 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.163271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e56b02-2bcd-453a-ae29-15769f78b007 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.163760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e56b02-2bcd-453a-ae29-15769f78b007 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.165115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e56b02-2bcd-453a-ae29-15769f78b007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.166792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e56b02-2bcd-453a-ae29-15769f78b007 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.173533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 91/191] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:14.174795 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e56b02-2bcd-453a-ae29-15769f78b007 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.176898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612417-3307-48e1-a1e8-8a38214e7423 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.209548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.231818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1bc3-d886-49a3-a189-7a307f360822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.232434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1bc3-d886-49a3-a189-7a307f360822 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.232708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1bc3-d886-49a3-a189-7a307f360822 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.232998 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1bc3-d886-49a3-a189-7a307f360822 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.233653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a1bc3-d886-49a3-a189-7a307f360822 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:14.233953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a1bc3-d886-49a3-a189-7a307f360822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.235391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a1bc3-d886-49a3-a189-7a307f360822 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.244527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 101/192] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:14.245438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1bc3-d886-49a3-a189-7a307f360822 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.310009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e56b02-2bcd-453a-ae29-15769f78b007 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.326143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.353480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78190be2-d6de-46ff-9fc7-1e97a7a37963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.354172 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78190be2-d6de-46ff-9fc7-1e97a7a37963 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.354452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78190be2-d6de-46ff-9fc7-1e97a7a37963 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.354722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78190be2-d6de-46ff-9fc7-1e97a7a37963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.380024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1bc3-d886-49a3-a189-7a307f360822 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.416517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37556404-2d2b-43ea-855d-1f9220be06f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.417136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37556404-2d2b-43ea-855d-1f9220be06f8 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.417424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37556404-2d2b-43ea-855d-1f9220be06f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.417698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37556404-2d2b-43ea-855d-1f9220be06f8 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.418352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37556404-2d2b-43ea-855d-1f9220be06f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.419815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37556404-2d2b-43ea-855d-1f9220be06f8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.436871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78190be2-d6de-46ff-9fc7-1e97a7a37963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.438395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78190be2-d6de-46ff-9fc7-1e97a7a37963 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.446984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 102/193] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:14 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:14.447813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37556404-2d2b-43ea-855d-1f9220be06f8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.482614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.581751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37556404-2d2b-43ea-855d-1f9220be06f8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.591578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 92/194] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:14.597322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bc582-29e1-451d-aabe-82c2dd29902f None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.597614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bc582-29e1-451d-aabe-82c2dd29902f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.597885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bc582-29e1-451d-aabe-82c2dd29902f None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.598313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.599257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 93/195] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:14.600497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bc582-29e1-451d-aabe-82c2dd29902f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.633677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdfa56-ee78-46e7-8b36-ab01a861ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.634335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdfa56-ee78-46e7-8b36-ab01a861ed9d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.634628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdfa56-ee78-46e7-8b36-ab01a861ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.634904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdfa56-ee78-46e7-8b36-ab01a861ed9d None admin] PATH_INFO: `/v3/users/94d3be25cb5f45609e708d7ebda1599c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.636449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdfa56-ee78-46e7-8b36-ab01a861ed9d None admin] RBAC: Authorizing `identity:get_user(user_id=94d3be25cb5f45609e708d7ebda1599c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.637590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdfa56-ee78-46e7-8b36-ab01a861ed9d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.639260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 103/196] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/users/94d3be25cb5f45609e708d7ebda1599c => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:14.640422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed6bc0-79a8-4722-b408-723e0f08c550 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.640704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed6bc0-79a8-4722-b408-723e0f08c550 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.640982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed6bc0-79a8-4722-b408-723e0f08c550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.661375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-83ed6bc0-79a8-4722-b408-723e0f08c550 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:14.662981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-83ed6bc0-79a8-4722-b408-723e0f08c550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:14.729861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bc582-29e1-451d-aabe-82c2dd29902f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.757595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 104/197] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:14.758493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed6bc0-79a8-4722-b408-723e0f08c550 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.766032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.782920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993da33d-512a-444a-b705-04999d125db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.783595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993da33d-512a-444a-b705-04999d125db2 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.784682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993da33d-512a-444a-b705-04999d125db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.784682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993da33d-512a-444a-b705-04999d125db2 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.785460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993da33d-512a-444a-b705-04999d125db2 None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.786917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993da33d-512a-444a-b705-04999d125db2 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:14.788683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 94/198] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:14.796685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993da33d-512a-444a-b705-04999d125db2 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:14.914716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed6bc0-79a8-4722-b408-723e0f08c550 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.922456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993da33d-512a-444a-b705-04999d125db2 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:14.934531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:14.965686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cfb6b-703c-426d-a07e-2783c4bf80ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.965686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cfb6b-703c-426d-a07e-2783c4bf80ff None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.965686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cfb6b-703c-426d-a07e-2783c4bf80ff None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.965686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cfb6b-703c-426d-a07e-2783c4bf80ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.992155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1015d-833a-424a-b5e4-ef62bcd88e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:14.993652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1015d-833a-424a-b5e4-ef62bcd88e62 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:14.994054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1015d-833a-424a-b5e4-ef62bcd88e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:14.994472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1015d-833a-424a-b5e4-ef62bcd88e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:14.995508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1015d-833a-424a-b5e4-ef62bcd88e62 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8, user.id=94d3be25cb5f45609e708d7ebda1599c) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:14.996259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1015d-833a-424a-b5e4-ef62bcd88e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:14.998875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1015d-833a-424a-b5e4-ef62bcd88e62 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.010757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 95/199] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/role_assignments?user.id=94d3be25cb5f45609e708d7ebda1599c&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=609b1a993a394f0e900e17edccebaea5 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:15.083684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cfb6b-703c-426d-a07e-2783c4bf80ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.085481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cfb6b-703c-426d-a07e-2783c4bf80ff None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.100112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1015d-833a-424a-b5e4-ef62bcd88e62 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.193118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.239604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 105/200] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:15.245420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cfb6b-703c-426d-a07e-2783c4bf80ff None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.275372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.319763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1015d-833a-424a-b5e4-ef62bcd88e62 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.356232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cfb6b-703c-426d-a07e-2783c4bf80ff None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.391610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f09624-54f6-46e2-9dd7-c1642a7129ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.392967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f09624-54f6-46e2-9dd7-c1642a7129ea None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.393248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f09624-54f6-46e2-9dd7-c1642a7129ea None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.394045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f09624-54f6-46e2-9dd7-c1642a7129ea None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.395360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f09624-54f6-46e2-9dd7-c1642a7129ea None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.397113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f09624-54f6-46e2-9dd7-c1642a7129ea None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.403270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 106/201] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:15.405597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f09624-54f6-46e2-9dd7-c1642a7129ea None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.475774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0cba1-4cd9-4181-a530-c5aed159e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.476359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0cba1-4cd9-4181-a530-c5aed159e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.476646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0cba1-4cd9-4181-a530-c5aed159e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.476920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0cba1-4cd9-4181-a530-c5aed159e4e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.495396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.512836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0cba1-4cd9-4181-a530-c5aed159e4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-54b0cba1-4cd9-4181-a530-c5aed159e4e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:15.525264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:15.526263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:15.527083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 96/202] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:15.529666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f09624-54f6-46e2-9dd7-c1642a7129ea None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.534886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0cba1-4cd9-4181-a530-c5aed159e4e8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.614378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62d7cf-121c-4f7c-b6e1-1815c88e3fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.615440 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62d7cf-121c-4f7c-b6e1-1815c88e3fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.615919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62d7cf-121c-4f7c-b6e1-1815c88e3fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.616385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62d7cf-121c-4f7c-b6e1-1815c88e3fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.617346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62d7cf-121c-4f7c-b6e1-1815c88e3fc2 None admin] RBAC: Adding query filter params (role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8, user.id=94d3be25cb5f45609e708d7ebda1599c) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:15.617870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62d7cf-121c-4f7c-b6e1-1815c88e3fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.619608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62d7cf-121c-4f7c-b6e1-1815c88e3fc2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.631969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 107/203] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/role_assignments?user.id=94d3be25cb5f45609e708d7ebda1599c&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=88da3cfff1d74296962f08ef7829479c => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:15.664538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0cba1-4cd9-4181-a530-c5aed159e4e8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.692416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:15.722778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49180-255f-4140-a01f-f29670c7c653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.723437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49180-255f-4140-a01f-f29670c7c653 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.723716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49180-255f-4140-a01f-f29670c7c653 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.723985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49180-255f-4140-a01f-f29670c7c653 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.724673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d49180-255f-4140-a01f-f29670c7c653 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:15.724978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d49180-255f-4140-a01f-f29670c7c653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.726435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d49180-255f-4140-a01f-f29670c7c653 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.740971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 97/204] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:15.742834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62d7cf-121c-4f7c-b6e1-1815c88e3fc2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:15.929703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62d7cf-121c-4f7c-b6e1-1815c88e3fc2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:15.967147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32fca5-a989-4e6b-bb68-277ddb28c053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:15.967814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32fca5-a989-4e6b-bb68-277ddb28c053 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:15.968096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32fca5-a989-4e6b-bb68-277ddb28c053 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:15.968371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32fca5-a989-4e6b-bb68-277ddb28c053 None admin] PATH_INFO: `/v3/users/e92da4719e04489499a8bc2819786ff1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:15.969660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32fca5-a989-4e6b-bb68-277ddb28c053 None admin] RBAC: Authorizing `identity:get_user(user_id=e92da4719e04489499a8bc2819786ff1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:15.971227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32fca5-a989-4e6b-bb68-277ddb28c053 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:15.973875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 108/205] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/users/e92da4719e04489499a8bc2819786ff1 => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:15.979958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49180-255f-4140-a01f-f29670c7c653 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.120781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49180-255f-4140-a01f-f29670c7c653 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.160125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584ff1e-6c02-45f4-8c0c-af3cddd274fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.160808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584ff1e-6c02-45f4-8c0c-af3cddd274fd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.161092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584ff1e-6c02-45f4-8c0c-af3cddd274fd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.161364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584ff1e-6c02-45f4-8c0c-af3cddd274fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.215807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:16.237096 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584ff1e-6c02-45f4-8c0c-af3cddd274fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.238485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584ff1e-6c02-45f4-8c0c-af3cddd274fd None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.344434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 98/206] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:16.350994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32fca5-a989-4e6b-bb68-277ddb28c053 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.379549 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:16.472374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32fca5-a989-4e6b-bb68-277ddb28c053 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.509226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8ec0f-cb34-4d3f-bc65-7b985a70f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.509779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8ec0f-cb34-4d3f-bc65-7b985a70f486 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.510055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8ec0f-cb34-4d3f-bc65-7b985a70f486 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.510327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8ec0f-cb34-4d3f-bc65-7b985a70f486 None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.511525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8ec0f-cb34-4d3f-bc65-7b985a70f486 None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.513133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8ec0f-cb34-4d3f-bc65-7b985a70f486 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.514778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 109/207] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:16.521923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584ff1e-6c02-45f4-8c0c-af3cddd274fd None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:16.623664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:16.638920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584ff1e-6c02-45f4-8c0c-af3cddd274fd None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:16.683113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5e766-9cee-479d-8a18-7d1e9b803480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:16.683785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5e766-9cee-479d-8a18-7d1e9b803480 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.684064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5e766-9cee-479d-8a18-7d1e9b803480 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.684332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5e766-9cee-479d-8a18-7d1e9b803480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.685066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5e766-9cee-479d-8a18-7d1e9b803480 None admin] RBAC: Adding query filter params (role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb, scope.project.id=87d64932a5ad41f8b5467e542488e3c8, user.id=e92da4719e04489499a8bc2819786ff1) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:16.685372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5e766-9cee-479d-8a18-7d1e9b803480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:16.686836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5e766-9cee-479d-8a18-7d1e9b803480 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:16.693202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 99/208] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:16 2022] GET /identity/v3/role_assignments?user.id=e92da4719e04489499a8bc2819786ff1&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:16.833715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d761-18a0-4e5d-99dc-86eb9770dc20 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.834023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d761-18a0-4e5d-99dc-86eb9770dc20 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.834262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d761-18a0-4e5d-99dc-86eb9770dc20 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.835996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 110/209] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:16.850337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c05401-c7a8-4557-895b-fb2eb6d4f7bd None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:16.850876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c05401-c7a8-4557-895b-fb2eb6d4f7bd None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:16.850876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c05401-c7a8-4557-895b-fb2eb6d4f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:16.876602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-20c05401-c7a8-4557-895b-fb2eb6d4f7bd None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:16.877850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-20c05401-c7a8-4557-895b-fb2eb6d4f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:16.984642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 100/210] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:17.213189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0552e-166c-49ab-8597-31a179e46f79 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.213674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0552e-166c-49ab-8597-31a179e46f79 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.213674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0552e-166c-49ab-8597-31a179e46f79 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.214988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 111/211] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:17.220357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a87cb-a492-49b8-a073-1d3ba80bc61b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.220640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a87cb-a492-49b8-a073-1d3ba80bc61b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.220911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a87cb-a492-49b8-a073-1d3ba80bc61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.248944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-e88a87cb-a492-49b8-a073-1d3ba80bc61b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:17.250130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e88a87cb-a492-49b8-a073-1d3ba80bc61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:17.289687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0552e-166c-49ab-8597-31a179e46f79 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:17.338619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 101/212] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:17.387362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:17.407656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0552e-166c-49ab-8597-31a179e46f79 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:17.444072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59932939-bcd0-4582-9d7e-24f69b1363b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:17.444769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59932939-bcd0-4582-9d7e-24f69b1363b3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.445048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59932939-bcd0-4582-9d7e-24f69b1363b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.445318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59932939-bcd0-4582-9d7e-24f69b1363b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.446475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59932939-bcd0-4582-9d7e-24f69b1363b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:17.448003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59932939-bcd0-4582-9d7e-24f69b1363b3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:17.449625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 112/213] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:17.455732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a87cb-a492-49b8-a073-1d3ba80bc61b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:17.484183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:17.533469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1435b-46ed-461d-bf29-85119d75e7c4 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.534840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1435b-46ed-461d-bf29-85119d75e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.535413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1435b-46ed-461d-bf29-85119d75e7c4 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.537261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 113/214] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:17.542727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b66ee-07bd-49b6-8b7c-4fbeb913a1dc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.543515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b66ee-07bd-49b6-8b7c-4fbeb913a1dc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.544111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b66ee-07bd-49b6-8b7c-4fbeb913a1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.562595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-016b66ee-07bd-49b6-8b7c-4fbeb913a1dc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:17.563945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-016b66ee-07bd-49b6-8b7c-4fbeb913a1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:17.567370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a87cb-a492-49b8-a073-1d3ba80bc61b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:17.604973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df16b1-0e7f-4cb6-bd13-ac179cda0fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:17.605938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df16b1-0e7f-4cb6-bd13-ac179cda0fb5 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.606410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df16b1-0e7f-4cb6-bd13-ac179cda0fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.606869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df16b1-0e7f-4cb6-bd13-ac179cda0fb5 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.607852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df16b1-0e7f-4cb6-bd13-ac179cda0fb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:17.609758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df16b1-0e7f-4cb6-bd13-ac179cda0fb5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:17.634611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 102/215] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:17 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:17.635539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df16b1-0e7f-4cb6-bd13-ac179cda0fb5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:17.647001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 114/216] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:17.715714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:17.770762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df16b1-0e7f-4cb6-bd13-ac179cda0fb5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:17.809284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3a0de-f074-43d5-8460-6aaa8b0dadd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:17.809927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3a0de-f074-43d5-8460-6aaa8b0dadd4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:17.810204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3a0de-f074-43d5-8460-6aaa8b0dadd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:17.810479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3a0de-f074-43d5-8460-6aaa8b0dadd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:17.822548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3a0de-f074-43d5-8460-6aaa8b0dadd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-3cc3a0de-f074-43d5-8460-6aaa8b0dadd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:17.827915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:17.828862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:17.829629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 103/217] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:17.835177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b66ee-07bd-49b6-8b7c-4fbeb913a1dc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:17.914846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3a0de-f074-43d5-8460-6aaa8b0dadd4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:17.927442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:17.959861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b66ee-07bd-49b6-8b7c-4fbeb913a1dc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.015789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24239b29-d9ad-44c9-90db-b7cbb99104ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.015994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24239b29-d9ad-44c9-90db-b7cbb99104ea None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.016254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24239b29-d9ad-44c9-90db-b7cbb99104ea None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.016679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24239b29-d9ad-44c9-90db-b7cbb99104ea None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.017734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24239b29-d9ad-44c9-90db-b7cbb99104ea None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:18.018140 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24239b29-d9ad-44c9-90db-b7cbb99104ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.020606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24239b29-d9ad-44c9-90db-b7cbb99104ea None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.032235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 115/218] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:18.033446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c848-30ad-48bf-9300-e221bdbed497 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.033735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c848-30ad-48bf-9300-e221bdbed497 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.034564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070c848-30ad-48bf-9300-e221bdbed497 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.036115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 116/219] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:18.041035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070c848-30ad-48bf-9300-e221bdbed497 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.058017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3a0de-f074-43d5-8460-6aaa8b0dadd4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.082641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.101232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf176-d9d7-4132-a6b7-e8e0d92c4ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.101992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf176-d9d7-4132-a6b7-e8e0d92c4ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.102343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf176-d9d7-4132-a6b7-e8e0d92c4ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.102689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf176-d9d7-4132-a6b7-e8e0d92c4ff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.119691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbf176-d9d7-4132-a6b7-e8e0d92c4ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-69cbf176-d9d7-4132-a6b7-e8e0d92c4ff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:18.125576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:18.126495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:18.127313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 104/220] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:18.129377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82ba0-1dc5-4e87-a4c1-3a8bda29ced3 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.129725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82ba0-1dc5-4e87-a4c1-3a8bda29ced3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.130065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82ba0-1dc5-4e87-a4c1-3a8bda29ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.158164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-e0f82ba0-1dc5-4e87-a4c1-3a8bda29ced3 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:18.160536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e0f82ba0-1dc5-4e87-a4c1-3a8bda29ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:18.194356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070c848-30ad-48bf-9300-e221bdbed497 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.230971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321676-1adc-4d36-8b57-78285dc139f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.231624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321676-1adc-4d36-8b57-78285dc139f3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.232007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321676-1adc-4d36-8b57-78285dc139f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.232121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321676-1adc-4d36-8b57-78285dc139f3 None admin] PATH_INFO: `/v3/users/bc7e95248c6c47489549819515a138ec` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.246794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321676-1adc-4d36-8b57-78285dc139f3 None admin] RBAC: Authorizing `identity:get_user(user_id=bc7e95248c6c47489549819515a138ec)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.248336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 105/221] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:18.248447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321676-1adc-4d36-8b57-78285dc139f3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.249542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f82ba0-1dc5-4e87-a4c1-3a8bda29ced3 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.251278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.255231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 117/222] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/users/bc7e95248c6c47489549819515a138ec => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:18.256653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321676-1adc-4d36-8b57-78285dc139f3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.359918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321676-1adc-4d36-8b57-78285dc139f3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.360980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f82ba0-1dc5-4e87-a4c1-3a8bda29ced3 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.373075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.397374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53801b-f5ff-4396-a9a7-3de9987e528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.397993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53801b-f5ff-4396-a9a7-3de9987e528d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.398273 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53801b-f5ff-4396-a9a7-3de9987e528d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.398547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53801b-f5ff-4396-a9a7-3de9987e528d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.405388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d553-04cc-469f-bc1c-2ef5ed5aa26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.406293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d553-04cc-469f-bc1c-2ef5ed5aa26c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.406808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d553-04cc-469f-bc1c-2ef5ed5aa26c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.407772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d553-04cc-469f-bc1c-2ef5ed5aa26c None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.408674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d553-04cc-469f-bc1c-2ef5ed5aa26c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:18.409740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d553-04cc-469f-bc1c-2ef5ed5aa26c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.411856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d553-04cc-469f-bc1c-2ef5ed5aa26c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.424793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 106/223] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:18.436178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d553-04cc-469f-bc1c-2ef5ed5aa26c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.508023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.517809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53801b-f5ff-4396-a9a7-3de9987e528d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.520024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53801b-f5ff-4396-a9a7-3de9987e528d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.647920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d553-04cc-469f-bc1c-2ef5ed5aa26c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.668338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 118/224] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:26:18.669219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53801b-f5ff-4396-a9a7-3de9987e528d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.694297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c0a76-4313-42a1-ad76-7855b39fddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.695864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c0a76-4313-42a1-ad76-7855b39fddff None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.696664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c0a76-4313-42a1-ad76-7855b39fddff None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.697142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c0a76-4313-42a1-ad76-7855b39fddff None admin] PATH_INFO: `/v3/users/94d3be25cb5f45609e708d7ebda1599c` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.699228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c0a76-4313-42a1-ad76-7855b39fddff None admin] RBAC: Authorizing `identity:get_user(user_id=94d3be25cb5f45609e708d7ebda1599c)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.701119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c0a76-4313-42a1-ad76-7855b39fddff None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.703404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 107/225] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/users/94d3be25cb5f45609e708d7ebda1599c => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:18.704388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c0a76-4313-42a1-ad76-7855b39fddff None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.761904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.793822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:18.803340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53801b-f5ff-4396-a9a7-3de9987e528d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.851283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95515ce-d47d-414b-a64a-fb25f06df95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.851283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95515ce-d47d-414b-a64a-fb25f06df95f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.851283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95515ce-d47d-414b-a64a-fb25f06df95f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.851283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95515ce-d47d-414b-a64a-fb25f06df95f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.858280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c0a76-4313-42a1-ad76-7855b39fddff None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:18.861783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95515ce-d47d-414b-a64a-fb25f06df95f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d95515ce-d47d-414b-a64a-fb25f06df95f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:18.867351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:18.868204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:18.868987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 119/226] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:18.869617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95515ce-d47d-414b-a64a-fb25f06df95f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:18.901749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee115e32-580c-43a7-a245-d13cac604cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:18.902788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee115e32-580c-43a7-a245-d13cac604cdd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:18.903297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee115e32-580c-43a7-a245-d13cac604cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:18.903781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee115e32-580c-43a7-a245-d13cac604cdd None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:18.905140 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee115e32-580c-43a7-a245-d13cac604cdd None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:18.906774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee115e32-580c-43a7-a245-d13cac604cdd None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:18.908752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 108/227] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:18.909771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee115e32-580c-43a7-a245-d13cac604cdd None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.011224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95515ce-d47d-414b-a64a-fb25f06df95f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.032232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee115e32-580c-43a7-a245-d13cac604cdd None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.048424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.056037 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5c351-17be-43a5-841a-24ad5b1e66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.057188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5c351-17be-43a5-841a-24ad5b1e66df None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.057758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5c351-17be-43a5-841a-24ad5b1e66df None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.058228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5c351-17be-43a5-841a-24ad5b1e66df None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.059702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5c351-17be-43a5-841a-24ad5b1e66df None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.061574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5c351-17be-43a5-841a-24ad5b1e66df None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.063882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 120/228] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:19.065175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5c351-17be-43a5-841a-24ad5b1e66df None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.086829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ab2f1-9d25-4529-a345-d7c573a92d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.087506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ab2f1-9d25-4529-a345-d7c573a92d1f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.087813 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ab2f1-9d25-4529-a345-d7c573a92d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.088090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ab2f1-9d25-4529-a345-d7c573a92d1f None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.088777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ab2f1-9d25-4529-a345-d7c573a92d1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:19.089087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ab2f1-9d25-4529-a345-d7c573a92d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.090490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ab2f1-9d25-4529-a345-d7c573a92d1f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.103224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 109/229] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:19.104053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ab2f1-9d25-4529-a345-d7c573a92d1f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.116381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.222217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5c351-17be-43a5-841a-24ad5b1e66df None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.229333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ab2f1-9d25-4529-a345-d7c573a92d1f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.258410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983c3ff-726d-4775-8406-454c88cb942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.259088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983c3ff-726d-4775-8406-454c88cb942b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.259332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983c3ff-726d-4775-8406-454c88cb942b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.259610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983c3ff-726d-4775-8406-454c88cb942b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.260348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983c3ff-726d-4775-8406-454c88cb942b None admin] RBAC: Adding query filter params (role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8, user.id=bc7e95248c6c47489549819515a138ec) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:19.260721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983c3ff-726d-4775-8406-454c88cb942b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.262176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983c3ff-726d-4775-8406-454c88cb942b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.268765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 121/230] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/role_assignments?user.id=bc7e95248c6c47489549819515a138ec&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=79bef6f5048d441d883bb015c7887170 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:19.269566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983c3ff-726d-4775-8406-454c88cb942b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.277612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030bca7-a0a7-4e46-ae58-41576c46bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.279503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bca7-a0a7-4e46-ae58-41576c46bd6d None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.279789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bca7-a0a7-4e46-ae58-41576c46bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.280064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030bca7-a0a7-4e46-ae58-41576c46bd6d None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/users/94d3be25cb5f45609e708d7ebda1599c/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.285289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030bca7-a0a7-4e46-ae58-41576c46bd6d None admin] RBAC: Authorizing `identity:create_grant(project_id=0c44eb0d46964399b792c9cc7986a2f8, user_id=94d3be25cb5f45609e708d7ebda1599c, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.287750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030bca7-a0a7-4e46-ae58-41576c46bd6d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.322719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 110/231] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:19 2022] PUT /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/users/94d3be25cb5f45609e708d7ebda1599c/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:19.390066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.403311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983c3ff-726d-4775-8406-454c88cb942b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.444368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b668fb-021e-486f-b4b2-c950171fb4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.445029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b668fb-021e-486f-b4b2-c950171fb4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.445313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b668fb-021e-486f-b4b2-c950171fb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.445590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b668fb-021e-486f-b4b2-c950171fb4a3 None admin] PATH_INFO: `/v3/users/94d3be25cb5f45609e708d7ebda1599c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.446759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b668fb-021e-486f-b4b2-c950171fb4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=94d3be25cb5f45609e708d7ebda1599c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.448409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b668fb-021e-486f-b4b2-c950171fb4a3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.450450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 122/232] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/users/94d3be25cb5f45609e708d7ebda1599c => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:19.456876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030bca7-a0a7-4e46-ae58-41576c46bd6d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.496275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:19.594280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030bca7-a0a7-4e46-ae58-41576c46bd6d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.634909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279db5b-f1e8-4276-a2ca-b02864e2e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.635591 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279db5b-f1e8-4276-a2ca-b02864e2e333 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.635873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279db5b-f1e8-4276-a2ca-b02864e2e333 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.636149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279db5b-f1e8-4276-a2ca-b02864e2e333 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.637346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279db5b-f1e8-4276-a2ca-b02864e2e333 None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.638802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279db5b-f1e8-4276-a2ca-b02864e2e333 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.640494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 111/233] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:19 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:19.647652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b668fb-021e-486f-b4b2-c950171fb4a3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:19.772336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b668fb-021e-486f-b4b2-c950171fb4a3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:19.822672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87281e44-2e6c-4138-914e-af52f27562a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:19.823381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281e44-2e6c-4138-914e-af52f27562a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:19.823658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281e44-2e6c-4138-914e-af52f27562a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:19.823933 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87281e44-2e6c-4138-914e-af52f27562a7 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/users/94d3be25cb5f45609e708d7ebda1599c/roles/88da3cfff1d74296962f08ef7829479c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:19.832446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281e44-2e6c-4138-914e-af52f27562a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c44eb0d46964399b792c9cc7986a2f8, user_id=94d3be25cb5f45609e708d7ebda1599c, role_id=88da3cfff1d74296962f08ef7829479c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:19.833923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87281e44-2e6c-4138-914e-af52f27562a7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:19.855136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 123/234] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:19 2022] PUT /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/users/94d3be25cb5f45609e708d7ebda1599c/roles/88da3cfff1d74296962f08ef7829479c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:20.090105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68342-1f6c-479e-ab69-0194b1654873 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.090585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68342-1f6c-479e-ab69-0194b1654873 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.090585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68342-1f6c-479e-ab69-0194b1654873 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.092175 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 112/235] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:20.098313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f653e9-014a-406f-8fd0-017224635aa3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.098597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f653e9-014a-406f-8fd0-017224635aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.098868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f653e9-014a-406f-8fd0-017224635aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.128003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d2f653e9-014a-406f-8fd0-017224635aa3 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:20.129201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d2f653e9-014a-406f-8fd0-017224635aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:20.144139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:20.212167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552daf1-b489-4d8f-91c2-14b8f8f73dfe None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.212513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552daf1-b489-4d8f-91c2-14b8f8f73dfe None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.212715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552daf1-b489-4d8f-91c2-14b8f8f73dfe None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.214051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 113/236] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:20.220545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b376c9f-a97c-4623-84fa-9fe0d657a9b1 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.220823 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b376c9f-a97c-4623-84fa-9fe0d657a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.221092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b376c9f-a97c-4623-84fa-9fe0d657a9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.226721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 124/237] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:20.251953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-6b376c9f-a97c-4623-84fa-9fe0d657a9b1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:20.253693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6b376c9f-a97c-4623-84fa-9fe0d657a9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:20.349612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 114/238] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:20.523181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f653e9-014a-406f-8fd0-017224635aa3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:20.652103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f653e9-014a-406f-8fd0-017224635aa3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:20.694005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac16ed-ef06-4a28-a20d-064388b4dd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:20.695056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac16ed-ef06-4a28-a20d-064388b4dd01 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.695556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac16ed-ef06-4a28-a20d-064388b4dd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.696048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac16ed-ef06-4a28-a20d-064388b4dd01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.697391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac16ed-ef06-4a28-a20d-064388b4dd01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:20.699060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac16ed-ef06-4a28-a20d-064388b4dd01 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:20.701141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 125/239] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:20.706348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b376c9f-a97c-4623-84fa-9fe0d657a9b1 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:20.709598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac16ed-ef06-4a28-a20d-064388b4dd01 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:20.728064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:20.759327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:20.849866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b376c9f-a97c-4623-84fa-9fe0d657a9b1 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:20.889186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45fb3e-fb85-4454-bbef-b09ab75e97af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:20.890192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45fb3e-fb85-4454-bbef-b09ab75e97af None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:20.890669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45fb3e-fb85-4454-bbef-b09ab75e97af None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:20.891173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45fb3e-fb85-4454-bbef-b09ab75e97af None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:20.892441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45fb3e-fb85-4454-bbef-b09ab75e97af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:20.894755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45fb3e-fb85-4454-bbef-b09ab75e97af None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:20.919868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 115/240] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:20 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:20.945013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac16ed-ef06-4a28-a20d-064388b4dd01 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:21.021218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dba210-4e02-473c-b2b2-539e488dac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:21.021899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dba210-4e02-473c-b2b2-539e488dac2e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.022182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dba210-4e02-473c-b2b2-539e488dac2e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.022529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dba210-4e02-473c-b2b2-539e488dac2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.043072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dba210-4e02-473c-b2b2-539e488dac2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d7dba210-4e02-473c-b2b2-539e488dac2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:21.048163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:21.049114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:21.049943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 126/241] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:21.055852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45fb3e-fb85-4454-bbef-b09ab75e97af None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:21.168622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:21.194215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45fb3e-fb85-4454-bbef-b09ab75e97af None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:21.238569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6360d77-e8ca-4db8-8bf9-2400b75dd0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:21.239222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6360d77-e8ca-4db8-8bf9-2400b75dd0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.239508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6360d77-e8ca-4db8-8bf9-2400b75dd0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.239785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6360d77-e8ca-4db8-8bf9-2400b75dd0e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.240479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6360d77-e8ca-4db8-8bf9-2400b75dd0e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:21.240789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6360d77-e8ca-4db8-8bf9-2400b75dd0e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:21.242180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6360d77-e8ca-4db8-8bf9-2400b75dd0e7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:21.251608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 116/242] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:21.257272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dba210-4e02-473c-b2b2-539e488dac2e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:21.353156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:21.382961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dba210-4e02-473c-b2b2-539e488dac2e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:21.425219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f868382-2d42-48ca-9aad-79f246800cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:21.425915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868382-2d42-48ca-9aad-79f246800cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.426201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868382-2d42-48ca-9aad-79f246800cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.426477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868382-2d42-48ca-9aad-79f246800cb6 None admin] PATH_INFO: `/v3/users/0d5b91c8d29b40fa99e074ac6b7359da` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.440972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868382-2d42-48ca-9aad-79f246800cb6 None admin] RBAC: Authorizing `identity:get_user(user_id=0d5b91c8d29b40fa99e074ac6b7359da)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:21.442519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868382-2d42-48ca-9aad-79f246800cb6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:21.444705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 127/243] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:21 2022] GET /identity/v3/users/0d5b91c8d29b40fa99e074ac6b7359da => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:21.450507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6360d77-e8ca-4db8-8bf9-2400b75dd0e7 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:21.587705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6360d77-e8ca-4db8-8bf9-2400b75dd0e7 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:21.631905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f7181-5cba-4f3e-b178-3b68788e41c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:21.632538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7181-5cba-4f3e-b178-3b68788e41c3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.632822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7181-5cba-4f3e-b178-3b68788e41c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.633100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7181-5cba-4f3e-b178-3b68788e41c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.652675 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:21.716929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f7181-5cba-4f3e-b178-3b68788e41c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:21.718423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f7181-5cba-4f3e-b178-3b68788e41c3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:21.805269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba178-22d9-4516-ad30-d4056967f3b0 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.805269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba178-22d9-4516-ad30-d4056967f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.805269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba178-22d9-4516-ad30-d4056967f3b0 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.805269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 128/244] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:21.815438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd30c7-493c-4fd8-ae13-f5df435f237e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.815721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd30c7-493c-4fd8-ae13-f5df435f237e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.816209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd30c7-493c-4fd8-ae13-f5df435f237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.848359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 117/245] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:21.849694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-08cd30c7-493c-4fd8-ae13-f5df435f237e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:21.849862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf513-4a0b-4c3d-aebd-214cf586b331 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.850157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf513-4a0b-4c3d-aebd-214cf586b331 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.850434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaf513-4a0b-4c3d-aebd-214cf586b331 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.851586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-08cd30c7-493c-4fd8-ae13-f5df435f237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:21.852099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 118/246] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:21.857435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf513-4a0b-4c3d-aebd-214cf586b331 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:21.916030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:21.943100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 129/247] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:21.944867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4723f-c8aa-47a9-bd2d-054c058c7ce3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:21.945313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4723f-c8aa-47a9-bd2d-054c058c7ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:21.945736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4723f-c8aa-47a9-bd2d-054c058c7ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:21.973485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d7f4723f-c8aa-47a9-bd2d-054c058c7ce3 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:21.975054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d7f4723f-c8aa-47a9-bd2d-054c058c7ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:21.989597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaf513-4a0b-4c3d-aebd-214cf586b331 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:22.070989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fb3bf-363b-4904-a101-44191211f1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:22.072114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fb3bf-363b-4904-a101-44191211f1ec None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.072398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fb3bf-363b-4904-a101-44191211f1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.072676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fb3bf-363b-4904-a101-44191211f1ec None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.075498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fb3bf-363b-4904-a101-44191211f1ec None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:22.077875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fb3bf-363b-4904-a101-44191211f1ec None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:22.080408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 119/248] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:21 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:22.088184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fb3bf-363b-4904-a101-44191211f1ec None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.112144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:22.133854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 130/249] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:22.160731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2292b-2245-42a7-b3c3-31ef1a32d2fe None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.161343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2292b-2245-42a7-b3c3-31ef1a32d2fe None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.161836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2292b-2245-42a7-b3c3-31ef1a32d2fe None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.163420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 131/250] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:22.168979 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32b4b3-251e-4334-890d-bdc747c58555 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.169525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32b4b3-251e-4334-890d-bdc747c58555 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.170015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32b4b3-251e-4334-890d-bdc747c58555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.189779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-df32b4b3-251e-4334-890d-bdc747c58555 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:22.192281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-df32b4b3-251e-4334-890d-bdc747c58555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:22.294677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fb3bf-363b-4904-a101-44191211f1ec None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:22.317507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 132/251] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:22.326709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:22.366043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d9f06-48d9-4aa6-a860-9be0086f25f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:22.366657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d9f06-48d9-4aa6-a860-9be0086f25f2 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.366982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d9f06-48d9-4aa6-a860-9be0086f25f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.367242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d9f06-48d9-4aa6-a860-9be0086f25f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.368217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d9f06-48d9-4aa6-a860-9be0086f25f2 None admin] RBAC: Adding query filter params (role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8, user.id=0d5b91c8d29b40fa99e074ac6b7359da) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:22.368734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d9f06-48d9-4aa6-a860-9be0086f25f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:22.370372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d9f06-48d9-4aa6-a860-9be0086f25f2 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:22.376979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 120/252] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/role_assignments?user.id=0d5b91c8d29b40fa99e074ac6b7359da&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:22.479515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32b4b3-251e-4334-890d-bdc747c58555 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.498173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d9f06-48d9-4aa6-a860-9be0086f25f2 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.675111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32b4b3-251e-4334-890d-bdc747c58555 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:22.692676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d9f06-48d9-4aa6-a860-9be0086f25f2 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:22.728078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:22.750778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89290701-d7f2-4742-97f4-d81ebaa31f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:22.751492 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89290701-d7f2-4742-97f4-d81ebaa31f6e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.751831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89290701-d7f2-4742-97f4-d81ebaa31f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.752114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89290701-d7f2-4742-97f4-d81ebaa31f6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.760105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13719da-b0e3-453e-b37b-10eb0ca98f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:22.760746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13719da-b0e3-453e-b37b-10eb0ca98f0c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:22.761026 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13719da-b0e3-453e-b37b-10eb0ca98f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:22.761298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13719da-b0e3-453e-b37b-10eb0ca98f0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:22.772994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89290701-d7f2-4742-97f4-d81ebaa31f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-89290701-d7f2-4742-97f4-d81ebaa31f6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:22.787876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:22.788767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:22.789545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 133/253] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:22.790180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89290701-d7f2-4742-97f4-d81ebaa31f6e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.794957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13719da-b0e3-453e-b37b-10eb0ca98f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-d13719da-b0e3-453e-b37b-10eb0ca98f0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:22.806073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:22.806984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:22.807801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 121/254] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:22.808443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13719da-b0e3-453e-b37b-10eb0ca98f0c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:22.889743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:22.956372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13719da-b0e3-453e-b37b-10eb0ca98f0c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.007659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89290701-d7f2-4742-97f4-d81ebaa31f6e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.028272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0779-f82d-451b-a722-ce3373cbc0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.028904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0779-f82d-451b-a722-ce3373cbc0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.029188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0779-f82d-451b-a722-ce3373cbc0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.029464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0779-f82d-451b-a722-ce3373cbc0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.030159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0779-f82d-451b-a722-ce3373cbc0c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:23.030468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0779-f82d-451b-a722-ce3373cbc0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.031899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0779-f82d-451b-a722-ce3373cbc0c9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.041037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 122/255] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.041879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0779-f82d-451b-a722-ce3373cbc0c9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.046649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e49f2-e627-4c85-8a0d-8fcde4fd7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.047653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e49f2-e627-4c85-8a0d-8fcde4fd7b1c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.048033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e49f2-e627-4c85-8a0d-8fcde4fd7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.048406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e49f2-e627-4c85-8a0d-8fcde4fd7b1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.060921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e49f2-e627-4c85-8a0d-8fcde4fd7b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7d6e49f2-e627-4c85-8a0d-8fcde4fd7b1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:23.066897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:23.069005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 134/256] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:23.071126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e49f2-e627-4c85-8a0d-8fcde4fd7b1c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.153565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.198097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.201868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0779-f82d-451b-a722-ce3373cbc0c9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.221901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e49f2-e627-4c85-8a0d-8fcde4fd7b1c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.268795 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7a50a-972d-4f0b-94df-bae7cb482029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.268795 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7a50a-972d-4f0b-94df-bae7cb482029 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.269441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7a50a-972d-4f0b-94df-bae7cb482029 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.269596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7a50a-972d-4f0b-94df-bae7cb482029 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.270833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7a50a-972d-4f0b-94df-bae7cb482029 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:23.270833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7a50a-972d-4f0b-94df-bae7cb482029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.274970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7a50a-972d-4f0b-94df-bae7cb482029 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.286122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 123/257] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.286948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7a50a-972d-4f0b-94df-bae7cb482029 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.290207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467aa53-4448-4178-8031-44d664f04c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.290840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467aa53-4448-4178-8031-44d664f04c72 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.291143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467aa53-4448-4178-8031-44d664f04c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.291417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467aa53-4448-4178-8031-44d664f04c72 None admin] PATH_INFO: `/v3/users/bc7e95248c6c47489549819515a138ec` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.292983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467aa53-4448-4178-8031-44d664f04c72 None admin] RBAC: Authorizing `identity:get_user(user_id=bc7e95248c6c47489549819515a138ec)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.294420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467aa53-4448-4178-8031-44d664f04c72 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.296008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 135/258] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/users/bc7e95248c6c47489549819515a138ec => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.297683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467aa53-4448-4178-8031-44d664f04c72 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.430302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7a50a-972d-4f0b-94df-bae7cb482029 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.435701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467aa53-4448-4178-8031-44d664f04c72 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.465212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29646201-4fcd-47db-9e33-00aae85df6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.466070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29646201-4fcd-47db-9e33-00aae85df6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.466493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29646201-4fcd-47db-9e33-00aae85df6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.466995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29646201-4fcd-47db-9e33-00aae85df6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.467800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29646201-4fcd-47db-9e33-00aae85df6a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:23.468316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29646201-4fcd-47db-9e33-00aae85df6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.469821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29646201-4fcd-47db-9e33-00aae85df6a7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.475471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.478906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 124/259] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.484186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29646201-4fcd-47db-9e33-00aae85df6a7 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.511596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c6e65-b39c-45f8-8717-9fae90a56a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.512209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.512948 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c6e65-b39c-45f8-8717-9fae90a56a57 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.513283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c6e65-b39c-45f8-8717-9fae90a56a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.513593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c6e65-b39c-45f8-8717-9fae90a56a57 None admin] PATH_INFO: `/v3/users/94d3be25cb5f45609e708d7ebda1599c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.520142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c6e65-b39c-45f8-8717-9fae90a56a57 None admin] RBAC: Authorizing `identity:get_user(user_id=94d3be25cb5f45609e708d7ebda1599c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.521829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c6e65-b39c-45f8-8717-9fae90a56a57 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.523606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 136/260] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/users/94d3be25cb5f45609e708d7ebda1599c => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.525198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c6e65-b39c-45f8-8717-9fae90a56a57 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.635568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29646201-4fcd-47db-9e33-00aae85df6a7 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.678008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102129a-8e90-431c-bf16-1a54c9ae09b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.679115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102129a-8e90-431c-bf16-1a54c9ae09b3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.679597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102129a-8e90-431c-bf16-1a54c9ae09b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.680073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102129a-8e90-431c-bf16-1a54c9ae09b3 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.681613 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102129a-8e90-431c-bf16-1a54c9ae09b3 None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.683463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102129a-8e90-431c-bf16-1a54c9ae09b3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.685639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 125/261] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.686962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102129a-8e90-431c-bf16-1a54c9ae09b3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.728793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c6e65-b39c-45f8-8717-9fae90a56a57 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.791687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712683b-2e77-41ad-9df3-776ccd3e03c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.792327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712683b-2e77-41ad-9df3-776ccd3e03c6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.792606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712683b-2e77-41ad-9df3-776ccd3e03c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.792880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712683b-2e77-41ad-9df3-776ccd3e03c6 None admin] PATH_INFO: `/v3/users/94d3be25cb5f45609e708d7ebda1599c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:23.799704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712683b-2e77-41ad-9df3-776ccd3e03c6 None admin] RBAC: Authorizing `identity:get_user(user_id=94d3be25cb5f45609e708d7ebda1599c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:23.801299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712683b-2e77-41ad-9df3-776ccd3e03c6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:23.803158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 137/262] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/users/94d3be25cb5f45609e708d7ebda1599c => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:23.808294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712683b-2e77-41ad-9df3-776ccd3e03c6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:23.851521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.858779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102129a-8e90-431c-bf16-1a54c9ae09b3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:23.909517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:23.925213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a46eb5-e1c5-4498-a5d9-f86f2c255e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:23.925836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46eb5-e1c5-4498-a5d9-f86f2c255e2a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:23.926123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46eb5-e1c5-4498-a5d9-f86f2c255e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:23.926396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a46eb5-e1c5-4498-a5d9-f86f2c255e2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.000603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712683b-2e77-41ad-9df3-776ccd3e03c6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.043953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a46eb5-e1c5-4498-a5d9-f86f2c255e2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:24.045437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a46eb5-e1c5-4498-a5d9-f86f2c255e2a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:24.067323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdae6f3-e20f-44de-af55-d33f54f29fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:24.068408 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdae6f3-e20f-44de-af55-d33f54f29fcf None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.068687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdae6f3-e20f-44de-af55-d33f54f29fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.068962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdae6f3-e20f-44de-af55-d33f54f29fcf None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/users/bc7e95248c6c47489549819515a138ec/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.071052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdae6f3-e20f-44de-af55-d33f54f29fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=0c44eb0d46964399b792c9cc7986a2f8, user_id=bc7e95248c6c47489549819515a138ec, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:24.072594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdae6f3-e20f-44de-af55-d33f54f29fcf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:24.089326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 138/263] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:23 2022] PUT /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/users/bc7e95248c6c47489549819515a138ec/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:24.090278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdae6f3-e20f-44de-af55-d33f54f29fcf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.200257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:24.219713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 126/264] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:24.220559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdae6f3-e20f-44de-af55-d33f54f29fcf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.221635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2dbec-b8d4-4f5f-b237-866218b52572 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.221938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2dbec-b8d4-4f5f-b237-866218b52572 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.222216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2dbec-b8d4-4f5f-b237-866218b52572 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.228069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 127/265] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:24.228960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2dbec-b8d4-4f5f-b237-866218b52572 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.235326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:24.269189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e179e9b-2963-48a6-be40-a06c0ec59042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:24.270269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e179e9b-2963-48a6-be40-a06c0ec59042 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.270829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e179e9b-2963-48a6-be40-a06c0ec59042 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.271189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e179e9b-2963-48a6-be40-a06c0ec59042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.362120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e179e9b-2963-48a6-be40-a06c0ec59042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:24.363729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e179e9b-2963-48a6-be40-a06c0ec59042 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:24.382330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2dbec-b8d4-4f5f-b237-866218b52572 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.420351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671282f-ebc1-403a-a62b-4748307025ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:24.421140 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671282f-ebc1-403a-a62b-4748307025ba None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.421341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671282f-ebc1-403a-a62b-4748307025ba None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.421591 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671282f-ebc1-403a-a62b-4748307025ba None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.422717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671282f-ebc1-403a-a62b-4748307025ba None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:24.424755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671282f-ebc1-403a-a62b-4748307025ba None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:24.426779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 128/266] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:24.428075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07099ae1-39ca-4128-9e2d-6ed7af1ccd62 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.428362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07099ae1-39ca-4128-9e2d-6ed7af1ccd62 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.428639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07099ae1-39ca-4128-9e2d-6ed7af1ccd62 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.430100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 129/267] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:24.431610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975d41-347a-40fc-b66f-d2d71706292b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.432145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975d41-347a-40fc-b66f-d2d71706292b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.432145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975d41-347a-40fc-b66f-d2d71706292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.450532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ab975d41-347a-40fc-b66f-d2d71706292b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:24.451820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ab975d41-347a-40fc-b66f-d2d71706292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:24.504933 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 139/268] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:24.506370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e179e9b-2963-48a6-be40-a06c0ec59042 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.514907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:24.526333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:24.529343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 130/269] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:24.538962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6697d-6003-425d-b9e0-913ca6f0f36e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.538962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6697d-6003-425d-b9e0-913ca6f0f36e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.538962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6697d-6003-425d-b9e0-913ca6f0f36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.569250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1cd6697d-6003-425d-b9e0-913ca6f0f36e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:24.570710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1cd6697d-6003-425d-b9e0-913ca6f0f36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:24.677679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e179e9b-2963-48a6-be40-a06c0ec59042 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.681493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 131/270] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:24.682634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6697d-6003-425d-b9e0-913ca6f0f36e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.734773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dabab7-5535-431a-8fff-1a1f495ba021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:24.736530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabab7-5535-431a-8fff-1a1f495ba021 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.738196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabab7-5535-431a-8fff-1a1f495ba021 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.738846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dabab7-5535-431a-8fff-1a1f495ba021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.740714 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dabab7-5535-431a-8fff-1a1f495ba021 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8, user.id=94d3be25cb5f45609e708d7ebda1599c) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:24.741436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dabab7-5535-431a-8fff-1a1f495ba021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:24.743733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dabab7-5535-431a-8fff-1a1f495ba021 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:24.758218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 140/271] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/role_assignments?user.id=94d3be25cb5f45609e708d7ebda1599c&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=609b1a993a394f0e900e17edccebaea5 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:24.759740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110b3f5-ac16-4383-99e3-e19649318ead None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.760456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110b3f5-ac16-4383-99e3-e19649318ead None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.760958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110b3f5-ac16-4383-99e3-e19649318ead None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.764225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 141/272] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:24.773293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497132-fba5-4041-b75d-3986283e8d77 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.773949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497132-fba5-4041-b75d-3986283e8d77 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.774423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497132-fba5-4041-b75d-3986283e8d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.808562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0c497132-fba5-4041-b75d-3986283e8d77 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:24.809823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0c497132-fba5-4041-b75d-3986283e8d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:24.860876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6697d-6003-425d-b9e0-913ca6f0f36e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:24.895337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:24.927792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af691-6fdf-4d3e-b1fd-46eadfd849dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:24.928838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af691-6fdf-4d3e-b1fd-46eadfd849dc None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:24.930051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af691-6fdf-4d3e-b1fd-46eadfd849dc None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:24.930542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0af691-6fdf-4d3e-b1fd-46eadfd849dc None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:24.935157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0af691-6fdf-4d3e-b1fd-46eadfd849dc None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:24.936918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0af691-6fdf-4d3e-b1fd-46eadfd849dc None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:24.942287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 132/273] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:24.943348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af691-6fdf-4d3e-b1fd-46eadfd849dc None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.958564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 142/274] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:24.958920 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c497132-fba5-4041-b75d-3986283e8d77 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:24.961971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.095298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0af691-6fdf-4d3e-b1fd-46eadfd849dc None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.117114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c497132-fba5-4041-b75d-3986283e8d77 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.144943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33afe0-25dd-48d1-b3f0-b22d6ecc8400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.146391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33afe0-25dd-48d1-b3f0-b22d6ecc8400 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.147159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33afe0-25dd-48d1-b3f0-b22d6ecc8400 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.147634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33afe0-25dd-48d1-b3f0-b22d6ecc8400 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.149664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33afe0-25dd-48d1-b3f0-b22d6ecc8400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.151907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33afe0-25dd-48d1-b3f0-b22d6ecc8400 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.156344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 133/275] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:25.160917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33afe0-25dd-48d1-b3f0-b22d6ecc8400 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.175671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b84c09-5e4d-46fc-8c0c-3c9fa5a9f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.176314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b84c09-5e4d-46fc-8c0c-3c9fa5a9f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.176591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b84c09-5e4d-46fc-8c0c-3c9fa5a9f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.176864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b84c09-5e4d-46fc-8c0c-3c9fa5a9f5f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.177597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b84c09-5e4d-46fc-8c0c-3c9fa5a9f5f2 None admin] RBAC: Adding query filter params (role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8, user.id=94d3be25cb5f45609e708d7ebda1599c) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:25.177905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b84c09-5e4d-46fc-8c0c-3c9fa5a9f5f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.179630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b84c09-5e4d-46fc-8c0c-3c9fa5a9f5f2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.190681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 143/276] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:24 2022] GET /identity/v3/role_assignments?user.id=94d3be25cb5f45609e708d7ebda1599c&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=88da3cfff1d74296962f08ef7829479c => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:25.191848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b84c09-5e4d-46fc-8c0c-3c9fa5a9f5f2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.237381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.268373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.292979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33afe0-25dd-48d1-b3f0-b22d6ecc8400 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.318365 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b84c09-5e4d-46fc-8c0c-3c9fa5a9f5f2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.331858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13ea3e-ebbd-40d5-a5aa-245ba13317a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.332510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13ea3e-ebbd-40d5-a5aa-245ba13317a9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.333162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13ea3e-ebbd-40d5-a5aa-245ba13317a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.333162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13ea3e-ebbd-40d5-a5aa-245ba13317a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.344929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13ea3e-ebbd-40d5-a5aa-245ba13317a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-ef13ea3e-ebbd-40d5-a5aa-245ba13317a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:25.351836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:25.352758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:25.353642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:25.357832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 134/277] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:25.358759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13ea3e-ebbd-40d5-a5aa-245ba13317a9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.369796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e286-c286-46a3-810d-22cba715be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.370912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e286-c286-46a3-810d-22cba715be24 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.371817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e286-c286-46a3-810d-22cba715be24 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.372390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e286-c286-46a3-810d-22cba715be24 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.373605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601e286-c286-46a3-810d-22cba715be24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.375866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601e286-c286-46a3-810d-22cba715be24 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.406265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 144/278] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:25 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:25.407465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e286-c286-46a3-810d-22cba715be24 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.493011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13ea3e-ebbd-40d5-a5aa-245ba13317a9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.521793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.543059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e286-c286-46a3-810d-22cba715be24 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.547925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8b71-f297-4fb4-a42e-f370349f1170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.548945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8b71-f297-4fb4-a42e-f370349f1170 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.550024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8b71-f297-4fb4-a42e-f370349f1170 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.550544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab8b71-f297-4fb4-a42e-f370349f1170 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.564569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab8b71-f297-4fb4-a42e-f370349f1170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-eeab8b71-f297-4fb4-a42e-f370349f1170 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:25.570533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:25.571541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:25.572333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:25.575467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.576085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 135/279] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:25.582148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8b71-f297-4fb4-a42e-f370349f1170 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.607871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f6ae3-c52c-418f-8d77-805ea9386ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.608466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f6ae3-c52c-418f-8d77-805ea9386ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.608752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f6ae3-c52c-418f-8d77-805ea9386ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.609031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f6ae3-c52c-418f-8d77-805ea9386ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.609772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f6ae3-c52c-418f-8d77-805ea9386ae6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:25.610100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f6ae3-c52c-418f-8d77-805ea9386ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.611560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f6ae3-c52c-418f-8d77-805ea9386ae6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.621560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 145/280] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:25.627632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f6ae3-c52c-418f-8d77-805ea9386ae6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.711463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab8b71-f297-4fb4-a42e-f370349f1170 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.749539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903693c2-b7ca-4de3-ae0a-4de2a3cd919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.750312 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903693c2-b7ca-4de3-ae0a-4de2a3cd919d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.750598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903693c2-b7ca-4de3-ae0a-4de2a3cd919d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.750698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f6ae3-c52c-418f-8d77-805ea9386ae6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.750876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903693c2-b7ca-4de3-ae0a-4de2a3cd919d None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.751585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903693c2-b7ca-4de3-ae0a-4de2a3cd919d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:25.751898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903693c2-b7ca-4de3-ae0a-4de2a3cd919d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.753318 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903693c2-b7ca-4de3-ae0a-4de2a3cd919d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.769479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 136/281] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:25.770410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903693c2-b7ca-4de3-ae0a-4de2a3cd919d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.795189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefd382-3ece-4a42-a87b-20e74b54a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.796177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefd382-3ece-4a42-a87b-20e74b54a533 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.796462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefd382-3ece-4a42-a87b-20e74b54a533 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.796735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefd382-3ece-4a42-a87b-20e74b54a533 None admin] PATH_INFO: `/v3/users/62c29857edc34495bd1f922148941d3e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.816468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefd382-3ece-4a42-a87b-20e74b54a533 None admin] RBAC: Authorizing `identity:get_user(user_id=62c29857edc34495bd1f922148941d3e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.818257 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefd382-3ece-4a42-a87b-20e74b54a533 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.820169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 146/282] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/users/62c29857edc34495bd1f922148941d3e => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:25.825851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefd382-3ece-4a42-a87b-20e74b54a533 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.829043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.883071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:25.902833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903693c2-b7ca-4de3-ae0a-4de2a3cd919d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:25.940248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d30b-8055-4d42-afd8-d3c73e410c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:25.940897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d30b-8055-4d42-afd8-d3c73e410c7f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:25.941184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d30b-8055-4d42-afd8-d3c73e410c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:25.941461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d30b-8055-4d42-afd8-d3c73e410c7f None admin] PATH_INFO: `/v3/users/0d5b91c8d29b40fa99e074ac6b7359da` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:25.942623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11d30b-8055-4d42-afd8-d3c73e410c7f None admin] RBAC: Authorizing `identity:get_user(user_id=0d5b91c8d29b40fa99e074ac6b7359da)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:25.944121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11d30b-8055-4d42-afd8-d3c73e410c7f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:25.945919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 137/283] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/users/0d5b91c8d29b40fa99e074ac6b7359da => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:25.953671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d30b-8055-4d42-afd8-d3c73e410c7f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:25.985423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefd382-3ece-4a42-a87b-20e74b54a533 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:26.024380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2380a-2cfd-4666-9a6d-b933c9656040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:26.025349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2380a-2cfd-4666-9a6d-b933c9656040 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.025850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2380a-2cfd-4666-9a6d-b933c9656040 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.026332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2380a-2cfd-4666-9a6d-b933c9656040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.027380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2380a-2cfd-4666-9a6d-b933c9656040 None admin] RBAC: Adding query filter params (role.id=79bef6f5048d441d883bb015c7887170, user.id=62c29857edc34495bd1f922148941d3e, scope.system=all) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:26.027934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2380a-2cfd-4666-9a6d-b933c9656040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:26.030027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2380a-2cfd-4666-9a6d-b933c9656040 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:26.036409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 147/284] 10.222.0.89 () {56 vars in 1308 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/role_assignments?user.id=62c29857edc34495bd1f922148941d3e&scope.system=all&role.id=79bef6f5048d441d883bb015c7887170 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:26.062110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d30b-8055-4d42-afd8-d3c73e410c7f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:26.070793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:26.103053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dde72f-c834-46d8-ad93-3b080d30c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:26.103704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde72f-c834-46d8-ad93-3b080d30c537 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.103987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde72f-c834-46d8-ad93-3b080d30c537 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.104267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde72f-c834-46d8-ad93-3b080d30c537 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.105467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dde72f-c834-46d8-ad93-3b080d30c537 None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:26.106959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dde72f-c834-46d8-ad93-3b080d30c537 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:26.109041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 138/285] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:25 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:26.115545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2380a-2cfd-4666-9a6d-b933c9656040 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:26.268793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2380a-2cfd-4666-9a6d-b933c9656040 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:26.283477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:26.322463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a133e-d948-4430-bc45-953ef6161256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:26.323166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a133e-d948-4430-bc45-953ef6161256 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.323448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a133e-d948-4430-bc45-953ef6161256 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.323727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a133e-d948-4430-bc45-953ef6161256 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/users/0d5b91c8d29b40fa99e074ac6b7359da/roles/d9a919d50d054dcb8a6af1fcf0cfdbdb` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.325665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a133e-d948-4430-bc45-953ef6161256 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c44eb0d46964399b792c9cc7986a2f8, user_id=0d5b91c8d29b40fa99e074ac6b7359da, role_id=d9a919d50d054dcb8a6af1fcf0cfdbdb)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:26.327146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a133e-d948-4430-bc45-953ef6161256 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:26.344076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 148/286] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:26:26 2022] PUT /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/users/0d5b91c8d29b40fa99e074ac6b7359da/roles/d9a919d50d054dcb8a6af1fcf0cfdbdb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:26.451724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7151b-0464-464d-87ee-e4971ea4bad8 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.452369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7151b-0464-464d-87ee-e4971ea4bad8 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.452875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7151b-0464-464d-87ee-e4971ea4bad8 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.454835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 139/287] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:26.461629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120d9f-d1d8-461b-9664-ced384270052 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:26.461924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120d9f-d1d8-461b-9664-ced384270052 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:26.462211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120d9f-d1d8-461b-9664-ced384270052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:26.492150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-71120d9f-d1d8-461b-9664-ced384270052 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:26.493382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-71120d9f-d1d8-461b-9664-ced384270052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:26.585626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 149/288] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:26.928615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7151b-0464-464d-87ee-e4971ea4bad8 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.070845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7151b-0464-464d-87ee-e4971ea4bad8 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.118213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62abc5a-a909-4b53-8c58-c84cf41b5ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.118856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62abc5a-a909-4b53-8c58-c84cf41b5ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.119163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62abc5a-a909-4b53-8c58-c84cf41b5ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.119439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62abc5a-a909-4b53-8c58-c84cf41b5ea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.133048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62abc5a-a909-4b53-8c58-c84cf41b5ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-c62abc5a-a909-4b53-8c58-c84cf41b5ea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:27.138089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:27.138983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:27.139777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 140/289] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:27.148016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120d9f-d1d8-461b-9664-ced384270052 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.273439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:27.279886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120d9f-d1d8-461b-9664-ced384270052 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.328864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5cf7f-0007-4202-800d-037433d9fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.329486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5cf7f-0007-4202-800d-037433d9fea8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.329766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5cf7f-0007-4202-800d-037433d9fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.330039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5cf7f-0007-4202-800d-037433d9fea8 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.330751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5cf7f-0007-4202-800d-037433d9fea8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:27.331082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5cf7f-0007-4202-800d-037433d9fea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.332464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5cf7f-0007-4202-800d-037433d9fea8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.346276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 150/290] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:27.351938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62abc5a-a909-4b53-8c58-c84cf41b5ea8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.396002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:27.478182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62abc5a-a909-4b53-8c58-c84cf41b5ea8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.513767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e36c2-4455-41da-b644-78f2a0fa4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.514407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e36c2-4455-41da-b644-78f2a0fa4882 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.514686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e36c2-4455-41da-b644-78f2a0fa4882 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.514979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e36c2-4455-41da-b644-78f2a0fa4882 None admin] PATH_INFO: `/v3/users/bc7e95248c6c47489549819515a138ec` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.516129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e36c2-4455-41da-b644-78f2a0fa4882 None admin] RBAC: Authorizing `identity:get_user(user_id=bc7e95248c6c47489549819515a138ec)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.517866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e36c2-4455-41da-b644-78f2a0fa4882 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.519496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 141/291] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/users/bc7e95248c6c47489549819515a138ec => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:27.525631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5cf7f-0007-4202-800d-037433d9fea8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:27.649540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5cf7f-0007-4202-800d-037433d9fea8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:27.697109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a216ce-96ea-412f-b414-7f636e9fad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:27.697734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a216ce-96ea-412f-b414-7f636e9fad7a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:27.698014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a216ce-96ea-412f-b414-7f636e9fad7a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:27.698287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a216ce-96ea-412f-b414-7f636e9fad7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:27.729540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:27.787738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a216ce-96ea-412f-b414-7f636e9fad7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:27.789127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a216ce-96ea-412f-b414-7f636e9fad7a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:27.926124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 151/292] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:27.927565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e36c2-4455-41da-b644-78f2a0fa4882 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:28.065887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e36c2-4455-41da-b644-78f2a0fa4882 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:28.067337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:28.097384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41d78e-47d8-4c2c-976b-5d093798e9ed None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.098120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41d78e-47d8-4c2c-976b-5d093798e9ed None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.098621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41d78e-47d8-4c2c-976b-5d093798e9ed None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.101235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 152/293] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:28.106655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c516a-7734-4b37-a006-f5a5f56e21cd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.107215 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c516a-7734-4b37-a006-f5a5f56e21cd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.107695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c516a-7734-4b37-a006-f5a5f56e21cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.121036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883bd2c-f132-471c-8f1f-e0a424a03811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:28.121677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883bd2c-f132-471c-8f1f-e0a424a03811 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.121959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883bd2c-f132-471c-8f1f-e0a424a03811 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.122235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883bd2c-f132-471c-8f1f-e0a424a03811 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.123836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883bd2c-f132-471c-8f1f-e0a424a03811 None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:28.125285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883bd2c-f132-471c-8f1f-e0a424a03811 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:28.127406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d48c516a-7734-4b37-a006-f5a5f56e21cd None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:28.128839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d48c516a-7734-4b37-a006-f5a5f56e21cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:28.131497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 142/294] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:27 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:28.133822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883bd2c-f132-471c-8f1f-e0a424a03811 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:28.214382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:28.242901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 153/295] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:28.242901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10ed76-d24b-455c-9b57-f69a238ee2c4 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.242901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10ed76-d24b-455c-9b57-f69a238ee2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.242901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10ed76-d24b-455c-9b57-f69a238ee2c4 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.242901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 154/296] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:28.249170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82643bf-8bdc-4e41-b942-7cef1ef19419 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.250817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82643bf-8bdc-4e41-b942-7cef1ef19419 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.251250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82643bf-8bdc-4e41-b942-7cef1ef19419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.284806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e82643bf-8bdc-4e41-b942-7cef1ef19419 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:28.287342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e82643bf-8bdc-4e41-b942-7cef1ef19419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:28.297400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883bd2c-f132-471c-8f1f-e0a424a03811 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:28.367112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c08e2f-2259-4a35-8e82-1b388eb18583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:28.367974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c08e2f-2259-4a35-8e82-1b388eb18583 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.368423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c08e2f-2259-4a35-8e82-1b388eb18583 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.368838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c08e2f-2259-4a35-8e82-1b388eb18583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.369708 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c08e2f-2259-4a35-8e82-1b388eb18583 None admin] RBAC: Adding query filter params (role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8, user.id=bc7e95248c6c47489549819515a138ec) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:28.370216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c08e2f-2259-4a35-8e82-1b388eb18583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:28.374394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c08e2f-2259-4a35-8e82-1b388eb18583 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:28.388868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 143/297] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:28 2022] GET /identity/v3/role_assignments?user.id=bc7e95248c6c47489549819515a138ec&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=79bef6f5048d441d883bb015c7887170 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:28.410653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 155/298] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:28.531128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c08e2f-2259-4a35-8e82-1b388eb18583 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:28.536769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ccd30-0125-461d-8a58-9f2ef6e10423 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.537075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ccd30-0125-461d-8a58-9f2ef6e10423 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.537331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ccd30-0125-461d-8a58-9f2ef6e10423 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.538708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 156/299] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:28.544696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bae50-e21a-4f94-a72a-aee4c488fb58 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.545027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bae50-e21a-4f94-a72a-aee4c488fb58 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.545258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bae50-e21a-4f94-a72a-aee4c488fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.566297 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-093bae50-e21a-4f94-a72a-aee4c488fb58 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:28.567652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-093bae50-e21a-4f94-a72a-aee4c488fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:28.597949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:28.659676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 157/300] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:28.679834 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c08e2f-2259-4a35-8e82-1b388eb18583 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:28.723687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bae50-e21a-4f94-a72a-aee4c488fb58 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:28.728529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657775f5-aaf8-454f-ad3f-a911e36cdea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:28.729564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657775f5-aaf8-454f-ad3f-a911e36cdea5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.730199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657775f5-aaf8-454f-ad3f-a911e36cdea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.730719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657775f5-aaf8-454f-ad3f-a911e36cdea5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.733581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657775f5-aaf8-454f-ad3f-a911e36cdea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:28.735694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657775f5-aaf8-454f-ad3f-a911e36cdea5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:28.739828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 144/301] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:28.747622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657775f5-aaf8-454f-ad3f-a911e36cdea5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:28.781747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:28.838480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093bae50-e21a-4f94-a72a-aee4c488fb58 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:28.873778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657775f5-aaf8-454f-ad3f-a911e36cdea5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:28.874611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b804e5-7c8d-4bb0-81a6-6710664b3d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:28.875307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b804e5-7c8d-4bb0-81a6-6710664b3d34 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.875589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b804e5-7c8d-4bb0-81a6-6710664b3d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.875864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b804e5-7c8d-4bb0-81a6-6710664b3d34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.876580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:28.887434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b804e5-7c8d-4bb0-81a6-6710664b3d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c5b804e5-7c8d-4bb0-81a6-6710664b3d34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:28.894987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:28.895868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:28.896650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 158/302] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:28.902345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b804e5-7c8d-4bb0-81a6-6710664b3d34 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:28.926553 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90305ac3-b09b-4404-8eb1-826614686fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:28.928066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90305ac3-b09b-4404-8eb1-826614686fc4 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:28.928836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90305ac3-b09b-4404-8eb1-826614686fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:28.929527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90305ac3-b09b-4404-8eb1-826614686fc4 None admin] PATH_INFO: `/v3/groups` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:28.930422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90305ac3-b09b-4404-8eb1-826614686fc4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:28.932321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90305ac3-b09b-4404-8eb1-826614686fc4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:28.951569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 145/303] 10.222.0.89 () {60 vars in 1134 bytes} [Fri Aug 26 15:26:28 2022] POST /identity/v3/groups => generated 229 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:29.016699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b804e5-7c8d-4bb0-81a6-6710664b3d34 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.029091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:29.040932 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90305ac3-b09b-4404-8eb1-826614686fc4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.063247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58568847-93da-4cbe-a83f-9184a721f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.063871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58568847-93da-4cbe-a83f-9184a721f626 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.064149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58568847-93da-4cbe-a83f-9184a721f626 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.064424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58568847-93da-4cbe-a83f-9184a721f626 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.065154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58568847-93da-4cbe-a83f-9184a721f626 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:29.065487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58568847-93da-4cbe-a83f-9184a721f626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:29.066899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58568847-93da-4cbe-a83f-9184a721f626 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:29.075723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 159/304] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:29.077021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60bb5-40fe-4d83-8934-1b69c5d3e10e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.077307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60bb5-40fe-4d83-8934-1b69c5d3e10e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.077581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60bb5-40fe-4d83-8934-1b69c5d3e10e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.079043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 160/305] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:29.083232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c60bb5-40fe-4d83-8934-1b69c5d3e10e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.172523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90305ac3-b09b-4404-8eb1-826614686fc4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.203450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c60bb5-40fe-4d83-8934-1b69c5d3e10e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.215791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895f573-6678-42cd-bd95-22b0153739e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.216626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895f573-6678-42cd-bd95-22b0153739e5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.217047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895f573-6678-42cd-bd95-22b0153739e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.217480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895f573-6678-42cd-bd95-22b0153739e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.229295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895f573-6678-42cd-bd95-22b0153739e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-9895f573-6678-42cd-bd95-22b0153739e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:29.234864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:29.235866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:29.236711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 146/306] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:29.237945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4ccac-6492-4589-9e4d-d6a6da1e75be None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.237945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4ccac-6492-4589-9e4d-d6a6da1e75be None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.237945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4ccac-6492-4589-9e4d-d6a6da1e75be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.253295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b47b8-66d2-4d57-b124-61ca0628d146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.254066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b47b8-66d2-4d57-b124-61ca0628d146 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.254429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b47b8-66d2-4d57-b124-61ca0628d146 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.254799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b47b8-66d2-4d57-b124-61ca0628d146 None admin] PATH_INFO: `/v3/users/78b728f7c9904c52aed35f274ac3b18c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.255654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-00b4ccac-6492-4589-9e4d-d6a6da1e75be None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:29.256856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-00b4ccac-6492-4589-9e4d-d6a6da1e75be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:29.272976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b47b8-66d2-4d57-b124-61ca0628d146 None admin] RBAC: Authorizing `identity:get_user(user_id=78b728f7c9904c52aed35f274ac3b18c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:29.274386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:29.274847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b47b8-66d2-4d57-b124-61ca0628d146 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:29.281900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 161/307] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/users/78b728f7c9904c52aed35f274ac3b18c => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:29.281900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b47b8-66d2-4d57-b124-61ca0628d146 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.313658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:29.341635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 147/308] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:29.343253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4ccac-6492-4589-9e4d-d6a6da1e75be None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.412396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b47b8-66d2-4d57-b124-61ca0628d146 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.456139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f3c94-c6d2-4985-8e2e-45dee88d4748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.457011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f3c94-c6d2-4985-8e2e-45dee88d4748 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.457428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f3c94-c6d2-4985-8e2e-45dee88d4748 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.458333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f3c94-c6d2-4985-8e2e-45dee88d4748 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.459318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f3c94-c6d2-4985-8e2e-45dee88d4748 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:29.460100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f3c94-c6d2-4985-8e2e-45dee88d4748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:29.462181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f3c94-c6d2-4985-8e2e-45dee88d4748 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:29.482812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 162/309] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:29.484557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f3c94-c6d2-4985-8e2e-45dee88d4748 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.490433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4ccac-6492-4589-9e4d-d6a6da1e75be None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.527553 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16419831-ace9-4ad2-b772-e43e7b11314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.528162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419831-ace9-4ad2-b772-e43e7b11314a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.528447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419831-ace9-4ad2-b772-e43e7b11314a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.528719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419831-ace9-4ad2-b772-e43e7b11314a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.529509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16419831-ace9-4ad2-b772-e43e7b11314a None admin] RBAC: Adding query filter params (role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb, user.id=78b728f7c9904c52aed35f274ac3b18c, scope.system=all) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:29.529825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16419831-ace9-4ad2-b772-e43e7b11314a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:29.531308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16419831-ace9-4ad2-b772-e43e7b11314a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:29.536510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 148/310] 10.222.0.89 () {56 vars in 1308 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/role_assignments?user.id=78b728f7c9904c52aed35f274ac3b18c&scope.system=all&role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:29.615005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:29.618702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16419831-ace9-4ad2-b772-e43e7b11314a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.629544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f3c94-c6d2-4985-8e2e-45dee88d4748 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.649363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:29.674700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899edce-d2b6-46c2-ab6f-e50e5df879e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.675379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899edce-d2b6-46c2-ab6f-e50e5df879e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.675663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899edce-d2b6-46c2-ab6f-e50e5df879e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.675939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899edce-d2b6-46c2-ab6f-e50e5df879e6 None admin] PATH_INFO: `/v3/users/62c29857edc34495bd1f922148941d3e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.677105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899edce-d2b6-46c2-ab6f-e50e5df879e6 None admin] RBAC: Authorizing `identity:get_user(user_id=62c29857edc34495bd1f922148941d3e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:29.679149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899edce-d2b6-46c2-ab6f-e50e5df879e6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:29.681113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 163/311] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/users/62c29857edc34495bd1f922148941d3e => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:29.687156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899edce-d2b6-46c2-ab6f-e50e5df879e6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.751501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16419831-ace9-4ad2-b772-e43e7b11314a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.787421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dfa2a-b15a-4ff0-9463-8d9080297a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.788281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dfa2a-b15a-4ff0-9463-8d9080297a7c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.788555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dfa2a-b15a-4ff0-9463-8d9080297a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.788938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dfa2a-b15a-4ff0-9463-8d9080297a7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.800363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dfa2a-b15a-4ff0-9463-8d9080297a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:29.801661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899edce-d2b6-46c2-ab6f-e50e5df879e6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-0e3dfa2a-b15a-4ff0-9463-8d9080297a7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:29.806041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:29.807100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:29.808093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:29.814334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 149/312] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:29.815657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dfa2a-b15a-4ff0-9463-8d9080297a7c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:29.840556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130b550-7eaf-4870-ab93-456385826d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.841472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130b550-7eaf-4870-ab93-456385826d99 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.841889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130b550-7eaf-4870-ab93-456385826d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.842302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130b550-7eaf-4870-ab93-456385826d99 None admin] PATH_INFO: `/v3/system/users/62c29857edc34495bd1f922148941d3e/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.843868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130b550-7eaf-4870-ab93-456385826d99 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=62c29857edc34495bd1f922148941d3e, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:29.845428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130b550-7eaf-4870-ab93-456385826d99 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:29.861448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 164/313] 10.222.0.89 () {58 vars in 1334 bytes} [Fri Aug 26 15:26:29 2022] PUT /identity/v3/system/users/62c29857edc34495bd1f922148941d3e/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:26:29.907899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:29.932784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dfa2a-b15a-4ff0-9463-8d9080297a7c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:29.970573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37d524-e875-499c-b8a1-0bf2492ce28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:29.971765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37d524-e875-499c-b8a1-0bf2492ce28d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:29.972047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37d524-e875-499c-b8a1-0bf2492ce28d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:29.972322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37d524-e875-499c-b8a1-0bf2492ce28d None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:29.973011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37d524-e875-499c-b8a1-0bf2492ce28d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:29.973408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37d524-e875-499c-b8a1-0bf2492ce28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:29.974797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37d524-e875-499c-b8a1-0bf2492ce28d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:29.984880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 150/314] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:29.990781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130b550-7eaf-4870-ab93-456385826d99 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.019732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.101397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130b550-7eaf-4870-ab93-456385826d99 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.139914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81513796-e933-4e4c-980d-3e2274a4b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.140552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81513796-e933-4e4c-980d-3e2274a4b821 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.140832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81513796-e933-4e4c-980d-3e2274a4b821 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.141106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81513796-e933-4e4c-980d-3e2274a4b821 None admin] PATH_INFO: `/v3/users/0d5b91c8d29b40fa99e074ac6b7359da` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.142516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81513796-e933-4e4c-980d-3e2274a4b821 None admin] RBAC: Authorizing `identity:get_user(user_id=0d5b91c8d29b40fa99e074ac6b7359da)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.144085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81513796-e933-4e4c-980d-3e2274a4b821 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.146155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 165/315] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:29 2022] GET /identity/v3/users/0d5b91c8d29b40fa99e074ac6b7359da => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:30.151882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37d524-e875-499c-b8a1-0bf2492ce28d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.258926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37d524-e875-499c-b8a1-0bf2492ce28d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.294314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b903b-2b8c-4d39-9ccc-5042c57dcfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.295278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b903b-2b8c-4d39-9ccc-5042c57dcfec None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.295772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b903b-2b8c-4d39-9ccc-5042c57dcfec None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.296246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b903b-2b8c-4d39-9ccc-5042c57dcfec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.314016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.368403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b903b-2b8c-4d39-9ccc-5042c57dcfec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.369925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b903b-2b8c-4d39-9ccc-5042c57dcfec None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.474056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 151/316] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:30.479633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81513796-e933-4e4c-980d-3e2274a4b821 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.586683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.602124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81513796-e933-4e4c-980d-3e2274a4b821 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.641059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9e0f2-d4d2-4ece-bdc5-3b34abdb037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.642156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9e0f2-d4d2-4ece-bdc5-3b34abdb037c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.642558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9e0f2-d4d2-4ece-bdc5-3b34abdb037c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.643413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9e0f2-d4d2-4ece-bdc5-3b34abdb037c None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.644938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9e0f2-d4d2-4ece-bdc5-3b34abdb037c None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.646804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9e0f2-d4d2-4ece-bdc5-3b34abdb037c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.649101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 166/317] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:30.654898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b903b-2b8c-4d39-9ccc-5042c57dcfec None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:30.697955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:30.766976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b903b-2b8c-4d39-9ccc-5042c57dcfec None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:30.798580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50092e1c-0a70-4fc7-b8c9-fc96d9099b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:30.799262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092e1c-0a70-4fc7-b8c9-fc96d9099b5d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:30.799561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092e1c-0a70-4fc7-b8c9-fc96d9099b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:30.802978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092e1c-0a70-4fc7-b8c9-fc96d9099b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:30.802978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50092e1c-0a70-4fc7-b8c9-fc96d9099b5d None admin] RBAC: Adding query filter params (role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8, user.id=0d5b91c8d29b40fa99e074ac6b7359da) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:30.802978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50092e1c-0a70-4fc7-b8c9-fc96d9099b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:30.802978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50092e1c-0a70-4fc7-b8c9-fc96d9099b5d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:30.808821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 152/318] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:30 2022] GET /identity/v3/role_assignments?user.id=0d5b91c8d29b40fa99e074ac6b7359da&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:31.045275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e35119-b6fb-4569-86c8-42335ce15f99 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.045749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e35119-b6fb-4569-86c8-42335ce15f99 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.046196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e35119-b6fb-4569-86c8-42335ce15f99 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.048370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 167/319] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:31.054034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cee0d-0fbf-4104-8952-7282804bffb9 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.054335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cee0d-0fbf-4104-8952-7282804bffb9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.054610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cee0d-0fbf-4104-8952-7282804bffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.073430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4c9cee0d-0fbf-4104-8952-7282804bffb9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:31.074660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4c9cee0d-0fbf-4104-8952-7282804bffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:31.145257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 153/320] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:31.414397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e35119-b6fb-4569-86c8-42335ce15f99 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:31.514891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e35119-b6fb-4569-86c8-42335ce15f99 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:31.547442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d2a0-f8c3-417e-a058-94b85c1a4088 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.547971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d2a0-f8c3-417e-a058-94b85c1a4088 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.547971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d2a0-f8c3-417e-a058-94b85c1a4088 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.548952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ca2c8-4a12-47a5-b56f-21c0576c0954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:31.550055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 154/321] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:31.550158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ca2c8-4a12-47a5-b56f-21c0576c0954 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.550363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ca2c8-4a12-47a5-b56f-21c0576c0954 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.550634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ca2c8-4a12-47a5-b56f-21c0576c0954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.551795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ca2c8-4a12-47a5-b56f-21c0576c0954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:31.553247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ca2c8-4a12-47a5-b56f-21c0576c0954 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:31.554752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad46cc0-5f53-4bd7-8a75-8a13fe0af30b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.555063 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad46cc0-5f53-4bd7-8a75-8a13fe0af30b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.555338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad46cc0-5f53-4bd7-8a75-8a13fe0af30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.559388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 168/322] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:31.560057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ca2c8-4a12-47a5-b56f-21c0576c0954 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:31.573053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1ad46cc0-5f53-4bd7-8a75-8a13fe0af30b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:31.574213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1ad46cc0-5f53-4bd7-8a75-8a13fe0af30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:31.589740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:31.600237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:31.645077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 155/323] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:31.670870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ca2c8-4a12-47a5-b56f-21c0576c0954 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:31.708729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d0605-0af8-4e1e-8a3b-a2af71d37097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:31.709346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d0605-0af8-4e1e-8a3b-a2af71d37097 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:31.709627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d0605-0af8-4e1e-8a3b-a2af71d37097 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:31.709900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d0605-0af8-4e1e-8a3b-a2af71d37097 None admin] PATH_INFO: `/v3/groups` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:31.710530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d0605-0af8-4e1e-8a3b-a2af71d37097 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:31.711996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d0605-0af8-4e1e-8a3b-a2af71d37097 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:31.728747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 169/324] 10.222.0.89 () {60 vars in 1134 bytes} [Fri Aug 26 15:26:31 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:31.916251 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad46cc0-5f53-4bd7-8a75-8a13fe0af30b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:32.021545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad46cc0-5f53-4bd7-8a75-8a13fe0af30b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:32.056844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d384-1110-464e-8818-cc6de4cc8394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:32.057528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d384-1110-464e-8818-cc6de4cc8394 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.057770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d384-1110-464e-8818-cc6de4cc8394 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.058043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d384-1110-464e-8818-cc6de4cc8394 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.062227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4407f-d131-48a6-8078-b612fc21043a None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.062621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4407f-d131-48a6-8078-b612fc21043a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.064738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4407f-d131-48a6-8078-b612fc21043a None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.064738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 170/325] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:32.070636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6de78b-00a2-465b-af8a-34f00c77c508 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.070919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6de78b-00a2-465b-af8a-34f00c77c508 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.071222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6de78b-00a2-465b-af8a-34f00c77c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.078199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935d384-1110-464e-8818-cc6de4cc8394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-b935d384-1110-464e-8818-cc6de4cc8394 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:32.083399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:32.084429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:32.085403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:32.087717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 156/326] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:32.093687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d384-1110-464e-8818-cc6de4cc8394 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:32.095251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ab6de78b-00a2-465b-af8a-34f00c77c508 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:32.097957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ab6de78b-00a2-465b-af8a-34f00c77c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:32.126376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:32.200870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 171/327] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:32.224921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d384-1110-464e-8818-cc6de4cc8394 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:32.267030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909dbec-0c52-4d92-b1cc-3d51dbd5c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:32.267701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909dbec-0c52-4d92-b1cc-3d51dbd5c65f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.267987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909dbec-0c52-4d92-b1cc-3d51dbd5c65f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.268261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909dbec-0c52-4d92-b1cc-3d51dbd5c65f None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.268949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909dbec-0c52-4d92-b1cc-3d51dbd5c65f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:32.269254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909dbec-0c52-4d92-b1cc-3d51dbd5c65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:32.270654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909dbec-0c52-4d92-b1cc-3d51dbd5c65f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:32.281486 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 157/328] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:32.292364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6de78b-00a2-465b-af8a-34f00c77c508 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:32.327899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:32.446266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6de78b-00a2-465b-af8a-34f00c77c508 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:32.487122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45d49-20e9-48ed-a256-9dda9a2544a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:32.487772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45d49-20e9-48ed-a256-9dda9a2544a9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.488051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45d49-20e9-48ed-a256-9dda9a2544a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.488324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45d49-20e9-48ed-a256-9dda9a2544a9 None admin] PATH_INFO: `/v3/users/78b728f7c9904c52aed35f274ac3b18c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.489919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f45d49-20e9-48ed-a256-9dda9a2544a9 None admin] RBAC: Authorizing `identity:get_user(user_id=78b728f7c9904c52aed35f274ac3b18c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:32.491472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f45d49-20e9-48ed-a256-9dda9a2544a9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:32.493426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 172/329] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:32 2022] GET /identity/v3/users/78b728f7c9904c52aed35f274ac3b18c => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:32.498865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909dbec-0c52-4d92-b1cc-3d51dbd5c65f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:32.573749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45d49-20e9-48ed-a256-9dda9a2544a9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:32.626179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:32.645390 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909dbec-0c52-4d92-b1cc-3d51dbd5c65f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:32.700364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99b1d-1dd2-4e81-8e0d-9ae4b1bd8514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:32.701030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99b1d-1dd2-4e81-8e0d-9ae4b1bd8514 None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.701309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99b1d-1dd2-4e81-8e0d-9ae4b1bd8514 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.701586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99b1d-1dd2-4e81-8e0d-9ae4b1bd8514 None admin] PATH_INFO: `/v3/system/users/78b728f7c9904c52aed35f274ac3b18c/roles/d9a919d50d054dcb8a6af1fcf0cfdbdb` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.703116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c99b1d-1dd2-4e81-8e0d-9ae4b1bd8514 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=78b728f7c9904c52aed35f274ac3b18c, role_id=d9a919d50d054dcb8a6af1fcf0cfdbdb)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:32.706331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c99b1d-1dd2-4e81-8e0d-9ae4b1bd8514 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:32.716355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:32.722605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 158/330] 10.222.0.89 () {58 vars in 1334 bytes} [Fri Aug 26 15:26:32 2022] PUT /identity/v3/system/users/78b728f7c9904c52aed35f274ac3b18c/roles/d9a919d50d054dcb8a6af1fcf0cfdbdb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:32.736361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45d49-20e9-48ed-a256-9dda9a2544a9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:32.791605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051295e-e556-4323-87d5-01a324eac665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:32.792373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051295e-e556-4323-87d5-01a324eac665 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.792654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051295e-e556-4323-87d5-01a324eac665 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.792923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051295e-e556-4323-87d5-01a324eac665 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.810446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051295e-e556-4323-87d5-01a324eac665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4051295e-e556-4323-87d5-01a324eac665 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:32.815810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:32.816756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:32.817563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 173/331] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:32.824600 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99b1d-1dd2-4e81-8e0d-9ae4b1bd8514 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:32.957561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99b1d-1dd2-4e81-8e0d-9ae4b1bd8514 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:32.997840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe7e71-5fc1-408e-bd04-1a3d87f7a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:32.998475 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7e71-5fc1-408e-bd04-1a3d87f7a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:32.998760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7e71-5fc1-408e-bd04-1a3d87f7a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:32.999063 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7e71-5fc1-408e-bd04-1a3d87f7a1b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:32.999747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe7e71-5fc1-408e-bd04-1a3d87f7a1b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:33.000058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe7e71-5fc1-408e-bd04-1a3d87f7a1b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:33.001454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe7e71-5fc1-408e-bd04-1a3d87f7a1b3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:33.011750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 159/332] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:33.019237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051295e-e556-4323-87d5-01a324eac665 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:33.151214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051295e-e556-4323-87d5-01a324eac665 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:33.192624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4619cd-cfcf-436a-91a1-b97b3da4fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:33.193293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4619cd-cfcf-436a-91a1-b97b3da4fa3f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.193572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4619cd-cfcf-436a-91a1-b97b3da4fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.193848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4619cd-cfcf-436a-91a1-b97b3da4fa3f None admin] PATH_INFO: `/v3/users/62c29857edc34495bd1f922148941d3e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.195141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4619cd-cfcf-436a-91a1-b97b3da4fa3f None admin] RBAC: Authorizing `identity:get_user(user_id=62c29857edc34495bd1f922148941d3e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:33.196737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4619cd-cfcf-436a-91a1-b97b3da4fa3f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:33.198445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 174/333] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:33 2022] GET /identity/v3/users/62c29857edc34495bd1f922148941d3e => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:33.204727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe7e71-5fc1-408e-bd04-1a3d87f7a1b3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:33.227073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:33.348177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe7e71-5fc1-408e-bd04-1a3d87f7a1b3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:33.384880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9d7ed-5c56-4257-aecb-c88dc5b02d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:33.385911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d7ed-5c56-4257-aecb-c88dc5b02d8a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:33.386391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d7ed-5c56-4257-aecb-c88dc5b02d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:33.386878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d7ed-5c56-4257-aecb-c88dc5b02d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:33.387831 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9d7ed-5c56-4257-aecb-c88dc5b02d8a None admin] RBAC: Adding query filter params (role.id=79bef6f5048d441d883bb015c7887170, user.id=62c29857edc34495bd1f922148941d3e, scope.system=all) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:33.388379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9d7ed-5c56-4257-aecb-c88dc5b02d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:33.390104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9d7ed-5c56-4257-aecb-c88dc5b02d8a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:33.406442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 160/334] 10.222.0.89 () {56 vars in 1308 bytes} [Fri Aug 26 15:26:33 2022] GET /identity/v3/role_assignments?user.id=62c29857edc34495bd1f922148941d3e&scope.system=all&role.id=79bef6f5048d441d883bb015c7887170 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:34.577094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7a959-3cf9-4ccf-8811-fc79b672bd57 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:34.577647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7a959-3cf9-4ccf-8811-fc79b672bd57 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:34.577751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7a959-3cf9-4ccf-8811-fc79b672bd57 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:34.579439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 175/335] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:34.589739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa7efe-5783-4eaa-8781-43b7d46e3ccf None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:34.590212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa7efe-5783-4eaa-8781-43b7d46e3ccf None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:34.590421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa7efe-5783-4eaa-8781-43b7d46e3ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:34.613987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-30fa7efe-5783-4eaa-8781-43b7d46e3ccf None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:34.615377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-30fa7efe-5783-4eaa-8781-43b7d46e3ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:34.696963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:34.704134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 161/336] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:35.052977 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a22492-9511-414e-a0f1-28cfa4e77a1e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:35.053360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a22492-9511-414e-a0f1-28cfa4e77a1e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:35.053743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a22492-9511-414e-a0f1-28cfa4e77a1e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:35.055976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 176/337] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:35.061540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a510949-4299-4745-95ce-eade70cecd1b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:35.062025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a510949-4299-4745-95ce-eade70cecd1b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:35.062465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a510949-4299-4745-95ce-eade70cecd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:35.084785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-9a510949-4299-4745-95ce-eade70cecd1b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:35.086191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9a510949-4299-4745-95ce-eade70cecd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:35.097210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a22492-9511-414e-a0f1-28cfa4e77a1e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:35.118050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:35.215569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 162/338] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:35.292618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a22492-9511-414e-a0f1-28cfa4e77a1e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:35.348537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17241f54-b8e4-44c7-a7e7-16497589b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:35.349261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17241f54-b8e4-44c7-a7e7-16497589b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:35.349615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17241f54-b8e4-44c7-a7e7-16497589b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:35.349947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17241f54-b8e4-44c7-a7e7-16497589b7a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:35.369831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17241f54-b8e4-44c7-a7e7-16497589b7a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-17241f54-b8e4-44c7-a7e7-16497589b7a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:35.376352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:35.377767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:35.378548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:35.379166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 177/339] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:35.385386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a510949-4299-4745-95ce-eade70cecd1b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:35.547934 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a510949-4299-4745-95ce-eade70cecd1b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:35.552633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0449908-21d6-4e44-a218-329af0558e2e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:35.553009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0449908-21d6-4e44-a218-329af0558e2e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:35.553367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0449908-21d6-4e44-a218-329af0558e2e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:35.556598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 178/340] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:35.560918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64861f4-6dd4-40c9-a270-bcc95b3e73da None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:35.561255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64861f4-6dd4-40c9-a270-bcc95b3e73da None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:35.561582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64861f4-6dd4-40c9-a270-bcc95b3e73da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:35.595369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f64861f4-6dd4-40c9-a270-bcc95b3e73da None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:35.598075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f64861f4-6dd4-40c9-a270-bcc95b3e73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:35.605641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:35.617208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592aa1-b0ff-46a5-92a5-6b643822fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:35.617834 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592aa1-b0ff-46a5-92a5-6b643822fb5c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:35.618120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592aa1-b0ff-46a5-92a5-6b643822fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:35.618403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592aa1-b0ff-46a5-92a5-6b643822fb5c None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:35.619120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592aa1-b0ff-46a5-92a5-6b643822fb5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:35.619431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592aa1-b0ff-46a5-92a5-6b643822fb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:35.620829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592aa1-b0ff-46a5-92a5-6b643822fb5c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:35.636056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 163/341] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:35.642760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592aa1-b0ff-46a5-92a5-6b643822fb5c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:35.730295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 179/342] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:35.821832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592aa1-b0ff-46a5-92a5-6b643822fb5c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:35.825625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64861f4-6dd4-40c9-a270-bcc95b3e73da None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:35.828299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:35.887009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f2f85-f659-4581-9372-af78c32df97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:35.887552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f2f85-f659-4581-9372-af78c32df97b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:35.887838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f2f85-f659-4581-9372-af78c32df97b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:35.888113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f2f85-f659-4581-9372-af78c32df97b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:35.997335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.010903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f2f85-f659-4581-9372-af78c32df97b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:36.011233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64861f4-6dd4-40c9-a270-bcc95b3e73da None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:36.012415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f2f85-f659-4581-9372-af78c32df97b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:36.076783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60bec8-9b3c-4322-9b52-3b13c2831d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:36.077431 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60bec8-9b3c-4322-9b52-3b13c2831d9b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.077713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60bec8-9b3c-4322-9b52-3b13c2831d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.077985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60bec8-9b3c-4322-9b52-3b13c2831d9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.103886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60bec8-9b3c-4322-9b52-3b13c2831d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9a60bec8-9b3c-4322-9b52-3b13c2831d9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:36.109465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:36.110360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:36.111755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 180/343] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:36.117067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60bec8-9b3c-4322-9b52-3b13c2831d9b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:36.217550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 164/344] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:36.222027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f2f85-f659-4581-9372-af78c32df97b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:36.228692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.304064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60bec8-9b3c-4322-9b52-3b13c2831d9b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:36.350825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaf80c-4336-4635-9990-65dc694fc145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:36.351633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaf80c-4336-4635-9990-65dc694fc145 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.351981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaf80c-4336-4635-9990-65dc694fc145 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.352355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaf80c-4336-4635-9990-65dc694fc145 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.353209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaf80c-4336-4635-9990-65dc694fc145 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:36.353565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaf80c-4336-4635-9990-65dc694fc145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:36.355906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaf80c-4336-4635-9990-65dc694fc145 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:36.357944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.370688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f2f85-f659-4581-9372-af78c32df97b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:36.372421 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 181/345] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:36.373367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaf80c-4336-4635-9990-65dc694fc145 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:36.419374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7629ff2-5c5d-4c7f-b7af-14f69cf98e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:36.420022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7629ff2-5c5d-4c7f-b7af-14f69cf98e56 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.420303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7629ff2-5c5d-4c7f-b7af-14f69cf98e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.420577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7629ff2-5c5d-4c7f-b7af-14f69cf98e56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.431977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7629ff2-5c5d-4c7f-b7af-14f69cf98e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-e7629ff2-5c5d-4c7f-b7af-14f69cf98e56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:36.438145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:36.439062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:36.439968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:36.441027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 165/346] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:36.442100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c71e7-7a5c-4d9d-87b3-2829f8a83857 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.442386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c71e7-7a5c-4d9d-87b3-2829f8a83857 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.442664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c71e7-7a5c-4d9d-87b3-2829f8a83857 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.443978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 166/347] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:36.445022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd422-62c3-466b-a2d6-de0a4e99f19a None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.445379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd422-62c3-466b-a2d6-de0a4e99f19a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.445657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebd422-62c3-466b-a2d6-de0a4e99f19a None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.447263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 167/348] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:36.447980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebd422-62c3-466b-a2d6-de0a4e99f19a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:36.516627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaf80c-4336-4635-9990-65dc694fc145 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:36.549160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.563055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4c264-7ece-4b93-b021-8014f77bba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:36.563701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4c264-7ece-4b93-b021-8014f77bba42 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.564161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4c264-7ece-4b93-b021-8014f77bba42 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.564288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4c264-7ece-4b93-b021-8014f77bba42 None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.565435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4c264-7ece-4b93-b021-8014f77bba42 None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:36.567312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4c264-7ece-4b93-b021-8014f77bba42 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:36.568760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 182/349] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:36.569862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9c39a-60e1-40e0-82c0-ca84a3a5d151 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.570140 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9c39a-60e1-40e0-82c0-ca84a3a5d151 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.570409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9c39a-60e1-40e0-82c0-ca84a3a5d151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.594685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-41c9c39a-60e1-40e0-82c0-ca84a3a5d151 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:36.596745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-41c9c39a-60e1-40e0-82c0-ca84a3a5d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:36.597277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebd422-62c3-466b-a2d6-de0a4e99f19a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:36.637811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb57ab-3a90-49ed-bfbf-98cd5339439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:36.638493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb57ab-3a90-49ed-bfbf-98cd5339439f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.638793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb57ab-3a90-49ed-bfbf-98cd5339439f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.638998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb57ab-3a90-49ed-bfbf-98cd5339439f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.661047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.678623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 183/350] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:36.680137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9c39a-60e1-40e0-82c0-ca84a3a5d151 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:36.718980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb57ab-3a90-49ed-bfbf-98cd5339439f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:36.720465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb57ab-3a90-49ed-bfbf-98cd5339439f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:36.828900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9c39a-60e1-40e0-82c0-ca84a3a5d151 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:36.864857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.875824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 168/351] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:36.878122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c19223-b26f-47e4-a920-5f7f427a22a0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.878414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c19223-b26f-47e4-a920-5f7f427a22a0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.878717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c19223-b26f-47e4-a920-5f7f427a22a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.883620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185736-f857-4a32-be8d-58f527cb5d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:36.884883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185736-f857-4a32-be8d-58f527cb5d27 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.885711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185736-f857-4a32-be8d-58f527cb5d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.886247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185736-f857-4a32-be8d-58f527cb5d27 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.887525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db185736-f857-4a32-be8d-58f527cb5d27 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:36.888013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db185736-f857-4a32-be8d-58f527cb5d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:36.890080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db185736-f857-4a32-be8d-58f527cb5d27 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:36.901875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-47c19223-b26f-47e4-a920-5f7f427a22a0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:36.903103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-47c19223-b26f-47e4-a920-5f7f427a22a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:36.904301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 184/352] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:36.905493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185736-f857-4a32-be8d-58f527cb5d27 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:36.962569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:36.985644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 169/353] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:36.987480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeecf8-60a2-4a12-a43d-40d44d425375 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:36.987849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeecf8-60a2-4a12-a43d-40d44d425375 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:36.988189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeecf8-60a2-4a12-a43d-40d44d425375 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:36.989580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 170/354] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:36.990410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeecf8-60a2-4a12-a43d-40d44d425375 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.039369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185736-f857-4a32-be8d-58f527cb5d27 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.084251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c0166-1c05-41de-9b06-8d11795d4bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.084890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0166-1c05-41de-9b06-8d11795d4bea None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.085168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0166-1c05-41de-9b06-8d11795d4bea None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.085444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0166-1c05-41de-9b06-8d11795d4bea None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.092529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c0166-1c05-41de-9b06-8d11795d4bea None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.093977 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c0166-1c05-41de-9b06-8d11795d4bea None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:37.096004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 185/355] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:37.096599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c0166-1c05-41de-9b06-8d11795d4bea None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.125789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeecf8-60a2-4a12-a43d-40d44d425375 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.171532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.182602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ca75-3f24-402e-857b-c78dc5684c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.183376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ca75-3f24-402e-857b-c78dc5684c2c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.183654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ca75-3f24-402e-857b-c78dc5684c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.183927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844ca75-3f24-402e-857b-c78dc5684c2c None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.185030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844ca75-3f24-402e-857b-c78dc5684c2c None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.186696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844ca75-3f24-402e-857b-c78dc5684c2c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:37.190209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 171/356] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:36 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:37.190209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ca75-3f24-402e-857b-c78dc5684c2c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.238465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c0166-1c05-41de-9b06-8d11795d4bea None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.254702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.281550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385ed7f-4edd-4ad4-a42d-b1a43aa46893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.283692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385ed7f-4edd-4ad4-a42d-b1a43aa46893 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.283692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385ed7f-4edd-4ad4-a42d-b1a43aa46893 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.283692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385ed7f-4edd-4ad4-a42d-b1a43aa46893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.316911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844ca75-3f24-402e-857b-c78dc5684c2c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.354492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6e40f-0278-49db-bcd9-ba37f34cfe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.355091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6e40f-0278-49db-bcd9-ba37f34cfe51 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.355373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6e40f-0278-49db-bcd9-ba37f34cfe51 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.355645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6e40f-0278-49db-bcd9-ba37f34cfe51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.363110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385ed7f-4edd-4ad4-a42d-b1a43aa46893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.364581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385ed7f-4edd-4ad4-a42d-b1a43aa46893 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:37.366858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6e40f-0278-49db-bcd9-ba37f34cfe51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-97b6e40f-0278-49db-bcd9-ba37f34cfe51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:37.372184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:37.373061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:37.373836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 172/357] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:37.374488 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43406f41-6683-4068-97b8-f7e6a993c3ad None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.375352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43406f41-6683-4068-97b8-f7e6a993c3ad None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.375352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43406f41-6683-4068-97b8-f7e6a993c3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.396030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-43406f41-6683-4068-97b8-f7e6a993c3ad None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:37.397218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-43406f41-6683-4068-97b8-f7e6a993c3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:37.424891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.487110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 173/358] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:37.488698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43406f41-6683-4068-97b8-f7e6a993c3ad None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.499662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 186/359] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:37.500480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385ed7f-4edd-4ad4-a42d-b1a43aa46893 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.552274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.641759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43406f41-6683-4068-97b8-f7e6a993c3ad None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.651782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385ed7f-4edd-4ad4-a42d-b1a43aa46893 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.691171 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e212a-977e-4f37-9cc3-9fa3eae3e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.691814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e212a-977e-4f37-9cc3-9fa3eae3e922 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.692090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e212a-977e-4f37-9cc3-9fa3eae3e922 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.692358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e212a-977e-4f37-9cc3-9fa3eae3e922 None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.693476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e212a-977e-4f37-9cc3-9fa3eae3e922 None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.694916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e212a-977e-4f37-9cc3-9fa3eae3e922 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:37.696707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 187/360] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:37.701621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e212a-977e-4f37-9cc3-9fa3eae3e922 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.708402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6885ba-a31c-4af4-9f23-1671b7cff53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.709118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6885ba-a31c-4af4-9f23-1671b7cff53e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.709474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6885ba-a31c-4af4-9f23-1671b7cff53e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.709858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6885ba-a31c-4af4-9f23-1671b7cff53e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.710867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6885ba-a31c-4af4-9f23-1671b7cff53e None admin] RBAC: Adding query filter params (group.id=8c41fee3a86c4da29fbdfa18eeb266f4, role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=87d64932a5ad41f8b5467e542488e3c8) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:37.711267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6885ba-a31c-4af4-9f23-1671b7cff53e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.712778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6885ba-a31c-4af4-9f23-1671b7cff53e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:37.719789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.727604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 174/361] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/role_assignments?group.id=8c41fee3a86c4da29fbdfa18eeb266f4&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=79bef6f5048d441d883bb015c7887170 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:37.729031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6885ba-a31c-4af4-9f23-1671b7cff53e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.844602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e212a-977e-4f37-9cc3-9fa3eae3e922 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.906111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f113b-ba2f-448c-b336-e80f56fb9f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.907442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f113b-ba2f-448c-b336-e80f56fb9f76 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.908030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f113b-ba2f-448c-b336-e80f56fb9f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.908505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f113b-ba2f-448c-b336-e80f56fb9f76 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.925646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6885ba-a31c-4af4-9f23-1671b7cff53e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:37.926824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f113b-ba2f-448c-b336-e80f56fb9f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:37.928443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-840f113b-ba2f-448c-b336-e80f56fb9f76 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:37.932514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:37.933418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 15:26:37.934206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:37.937773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 188/362] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:37.938858 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f113b-ba2f-448c-b336-e80f56fb9f76 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:37.991727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285aa51-cea0-4551-a5a4-c380a83ac828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:37.993129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285aa51-cea0-4551-a5a4-c380a83ac828 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:37.993412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285aa51-cea0-4551-a5a4-c380a83ac828 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:37.993684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285aa51-cea0-4551-a5a4-c380a83ac828 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:37.994365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285aa51-cea0-4551-a5a4-c380a83ac828 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:37.994671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285aa51-cea0-4551-a5a4-c380a83ac828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:37.996302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285aa51-cea0-4551-a5a4-c380a83ac828 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.008967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 175/363] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.009811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285aa51-cea0-4551-a5a4-c380a83ac828 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.061013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.093908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f113b-ba2f-448c-b336-e80f56fb9f76 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.134156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285aa51-cea0-4551-a5a4-c380a83ac828 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.141437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d3ae-5a65-4bdd-83d3-1724bf01ab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.142810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d3ae-5a65-4bdd-83d3-1724bf01ab0b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.144269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d3ae-5a65-4bdd-83d3-1724bf01ab0b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.144269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d3ae-5a65-4bdd-83d3-1724bf01ab0b None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.145801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5d3ae-5a65-4bdd-83d3-1724bf01ab0b None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.147278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5d3ae-5a65-4bdd-83d3-1724bf01ab0b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.148921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 189/364] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:37 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.149671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d3ae-5a65-4bdd-83d3-1724bf01ab0b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.182869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7a53-28b0-4e6f-8e98-96a6d92fd82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.183446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7a53-28b0-4e6f-8e98-96a6d92fd82f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.183874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7a53-28b0-4e6f-8e98-96a6d92fd82f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.184265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7a53-28b0-4e6f-8e98-96a6d92fd82f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.185143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e7a53-28b0-4e6f-8e98-96a6d92fd82f None admin] RBAC: Adding query filter params (group.id=8c41fee3a86c4da29fbdfa18eeb266f4, role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=87d64932a5ad41f8b5467e542488e3c8) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:38.185464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e7a53-28b0-4e6f-8e98-96a6d92fd82f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.187532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e7a53-28b0-4e6f-8e98-96a6d92fd82f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.196394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 176/365] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/role_assignments?group.id=8c41fee3a86c4da29fbdfa18eeb266f4&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=88da3cfff1d74296962f08ef7829479c => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.197539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7a53-28b0-4e6f-8e98-96a6d92fd82f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.232908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.293117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d3ae-5a65-4bdd-83d3-1724bf01ab0b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.331455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7a53-28b0-4e6f-8e98-96a6d92fd82f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.349894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ff14b-9d14-4e14-a5ca-172dc63e4b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.351013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff14b-9d14-4e14-a5ca-172dc63e4b39 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.351298 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff14b-9d14-4e14-a5ca-172dc63e4b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.351847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ff14b-9d14-4e14-a5ca-172dc63e4b39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.368376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ff14b-9d14-4e14-a5ca-172dc63e4b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-015ff14b-9d14-4e14-a5ca-172dc63e4b39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:38.373340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:38.374204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:38.375254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 190/366] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:38.376155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ff14b-9d14-4e14-a5ca-172dc63e4b39 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.380768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.389571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5198700-eea5-4ff1-9a06-4f0b6865d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.390729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5198700-eea5-4ff1-9a06-4f0b6865d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.391620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5198700-eea5-4ff1-9a06-4f0b6865d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.392120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5198700-eea5-4ff1-9a06-4f0b6865d1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.393540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5198700-eea5-4ff1-9a06-4f0b6865d1c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:38.394135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5198700-eea5-4ff1-9a06-4f0b6865d1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.395873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5198700-eea5-4ff1-9a06-4f0b6865d1c3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.406231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 177/367] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.407442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5198700-eea5-4ff1-9a06-4f0b6865d1c3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.493501 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ff14b-9d14-4e14-a5ca-172dc63e4b39 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.524668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.535728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5198700-eea5-4ff1-9a06-4f0b6865d1c3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.544719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b349f-b29a-4d0a-8553-55b9f166a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.546294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b349f-b29a-4d0a-8553-55b9f166a5ff None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.546784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b349f-b29a-4d0a-8553-55b9f166a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.547680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b349f-b29a-4d0a-8553-55b9f166a5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.573116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484e8b8-6a2a-4aad-8061-f6dc5b7fdcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.573757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484e8b8-6a2a-4aad-8061-f6dc5b7fdcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.574046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484e8b8-6a2a-4aad-8061-f6dc5b7fdcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.574376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484e8b8-6a2a-4aad-8061-f6dc5b7fdcb9 None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.575625 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484e8b8-6a2a-4aad-8061-f6dc5b7fdcb9 None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.577123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484e8b8-6a2a-4aad-8061-f6dc5b7fdcb9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.578726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 178/368] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.584593 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484e8b8-6a2a-4aad-8061-f6dc5b7fdcb9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.639493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b349f-b29a-4d0a-8553-55b9f166a5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.640858 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b349f-b29a-4d0a-8553-55b9f166a5ff None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.644742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.712095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484e8b8-6a2a-4aad-8061-f6dc5b7fdcb9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.754807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 191/369] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:38.755508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b349f-b29a-4d0a-8553-55b9f166a5ff None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.759812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85499-7413-4932-aa59-374e9c3796e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.760739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85499-7413-4932-aa59-374e9c3796e3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.761217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85499-7413-4932-aa59-374e9c3796e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.761684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85499-7413-4932-aa59-374e9c3796e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.762555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85499-7413-4932-aa59-374e9c3796e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:38.763103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85499-7413-4932-aa59-374e9c3796e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.765355 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85499-7413-4932-aa59-374e9c3796e3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.778316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 179/370] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.779747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85499-7413-4932-aa59-374e9c3796e3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.819770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.874898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b349f-b29a-4d0a-8553-55b9f166a5ff None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.878267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:38.921536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6e8dd-4808-414b-89be-6661dcab21f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.922205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6e8dd-4808-414b-89be-6661dcab21f3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.922486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6e8dd-4808-414b-89be-6661dcab21f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.922952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6e8dd-4808-414b-89be-6661dcab21f3 None admin] PATH_INFO: `/v3/users/78b728f7c9904c52aed35f274ac3b18c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.924981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6e8dd-4808-414b-89be-6661dcab21f3 None admin] RBAC: Authorizing `identity:get_user(user_id=78b728f7c9904c52aed35f274ac3b18c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.926767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6e8dd-4808-414b-89be-6661dcab21f3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.929665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 192/371] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/users/78b728f7c9904c52aed35f274ac3b18c => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.930582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6e8dd-4808-414b-89be-6661dcab21f3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:38.939175 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85499-7413-4932-aa59-374e9c3796e3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:38.976725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47854518-4cc1-4ff1-8418-21c4e37af0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:38.977496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47854518-4cc1-4ff1-8418-21c4e37af0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:38.977755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47854518-4cc1-4ff1-8418-21c4e37af0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:38.978081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47854518-4cc1-4ff1-8418-21c4e37af0a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:38.978811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47854518-4cc1-4ff1-8418-21c4e37af0a8 None admin] RBAC: Adding query filter params (group.id=8c41fee3a86c4da29fbdfa18eeb266f4, role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:38.980004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47854518-4cc1-4ff1-8418-21c4e37af0a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:38.980789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47854518-4cc1-4ff1-8418-21c4e37af0a8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:38.995189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 180/372] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/role_assignments?group.id=8c41fee3a86c4da29fbdfa18eeb266f4&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=79bef6f5048d441d883bb015c7887170 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:38.996400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47854518-4cc1-4ff1-8418-21c4e37af0a8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.051746 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6e8dd-4808-414b-89be-6661dcab21f3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.090238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f978-69d0-4683-941c-b75322a3a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.091102 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f978-69d0-4683-941c-b75322a3a62a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.091489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f978-69d0-4683-941c-b75322a3a62a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.091880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f978-69d0-4683-941c-b75322a3a62a None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.093253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75f978-69d0-4683-941c-b75322a3a62a None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.094888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75f978-69d0-4683-941c-b75322a3a62a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.102962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 193/373] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:39.102962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f978-69d0-4683-941c-b75322a3a62a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.187131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.198786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.221571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47854518-4cc1-4ff1-8418-21c4e37af0a8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.296193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4a9fc-8b04-4888-954d-8aa18c29c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.297412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4a9fc-8b04-4888-954d-8aa18c29c9de None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.297909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4a9fc-8b04-4888-954d-8aa18c29c9de None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.299958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f978-69d0-4683-941c-b75322a3a62a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.300988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4a9fc-8b04-4888-954d-8aa18c29c9de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.368493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4869c-25d2-41a5-8e01-58246c83b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.369130 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4869c-25d2-41a5-8e01-58246c83b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.369416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4869c-25d2-41a5-8e01-58246c83b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.369736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4869c-25d2-41a5-8e01-58246c83b3e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.370538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4869c-25d2-41a5-8e01-58246c83b3e9 None admin] RBAC: Adding query filter params (role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb, user.id=78b728f7c9904c52aed35f274ac3b18c, scope.system=all) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:39.370908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4869c-25d2-41a5-8e01-58246c83b3e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.372394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4869c-25d2-41a5-8e01-58246c83b3e9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.387313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 194/374] 10.222.0.89 () {56 vars in 1308 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/role_assignments?user.id=78b728f7c9904c52aed35f274ac3b18c&scope.system=all&role.id=d9a919d50d054dcb8a6af1fcf0cfdbdb => generated 510 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:39.388290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4869c-25d2-41a5-8e01-58246c83b3e9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.456166 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4a9fc-8b04-4888-954d-8aa18c29c9de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.457634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4a9fc-8b04-4888-954d-8aa18c29c9de None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.532752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.542918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4869c-25d2-41a5-8e01-58246c83b3e9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.597547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183eda4-7742-44cc-bd35-08ed94dbc56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.598221 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183eda4-7742-44cc-bd35-08ed94dbc56f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.598504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183eda4-7742-44cc-bd35-08ed94dbc56f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.598778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183eda4-7742-44cc-bd35-08ed94dbc56f None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.600136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183eda4-7742-44cc-bd35-08ed94dbc56f None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.601898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183eda4-7742-44cc-bd35-08ed94dbc56f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.603901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 195/375] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:39.610213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183eda4-7742-44cc-bd35-08ed94dbc56f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.684315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.714070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 181/376] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:39.720455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4a9fc-8b04-4888-954d-8aa18c29c9de None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:39.796411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183eda4-7742-44cc-bd35-08ed94dbc56f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.861595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a0d69-fc81-4e40-8313-e35ee824d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.862219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a0d69-fc81-4e40-8313-e35ee824d2fa None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.862501 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a0d69-fc81-4e40-8313-e35ee824d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.862774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a0d69-fc81-4e40-8313-e35ee824d2fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.863543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a0d69-fc81-4e40-8313-e35ee824d2fa None admin] RBAC: Adding query filter params (group.id=8c41fee3a86c4da29fbdfa18eeb266f4, role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:39.863850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a0d69-fc81-4e40-8313-e35ee824d2fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.865295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a0d69-fc81-4e40-8313-e35ee824d2fa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.875349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 196/377] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/role_assignments?group.id=8c41fee3a86c4da29fbdfa18eeb266f4&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=88da3cfff1d74296962f08ef7829479c => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:39.879916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30050c-1763-417d-bf9d-e2a0ab5797a1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.880199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30050c-1763-417d-bf9d-e2a0ab5797a1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.880475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30050c-1763-417d-bf9d-e2a0ab5797a1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.881855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 197/378] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:39.890732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8acedb-3a6e-4cdb-a78d-3e258d9a9a42 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.891349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8acedb-3a6e-4cdb-a78d-3e258d9a9a42 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.891578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8acedb-3a6e-4cdb-a78d-3e258d9a9a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.917303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4a9fc-8b04-4888-954d-8aa18c29c9de None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:39.930497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9f8acedb-3a6e-4cdb-a78d-3e258d9a9a42 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:39.931740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9f8acedb-3a6e-4cdb-a78d-3e258d9a9a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:39.981564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:39.986909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87074e-406b-4cd4-a7db-745a5d178e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:39.987600 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87074e-406b-4cd4-a7db-745a5d178e9d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:39.987882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87074e-406b-4cd4-a7db-745a5d178e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:39.988155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87074e-406b-4cd4-a7db-745a5d178e9d None admin] PATH_INFO: `/v3/projects/f82c5c1108704750815ed9407c515587` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:39.989638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87074e-406b-4cd4-a7db-745a5d178e9d None admin] RBAC: Authorizing `identity:get_project(project_id=f82c5c1108704750815ed9407c515587)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:39.991162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87074e-406b-4cd4-a7db-745a5d178e9d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:39.992903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 182/379] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/projects/f82c5c1108704750815ed9407c515587 => generated 344 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:40.000224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87074e-406b-4cd4-a7db-745a5d178e9d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.068876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:40.092298 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 198/380] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:40.122762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87074e-406b-4cd4-a7db-745a5d178e9d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.159942 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0140a50-e820-4dc1-9a65-c7a4ae3d7bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.160582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0140a50-e820-4dc1-9a65-c7a4ae3d7bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.160864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0140a50-e820-4dc1-9a65-c7a4ae3d7bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.161200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0140a50-e820-4dc1-9a65-c7a4ae3d7bb2 None admin] PATH_INFO: `/v3/groups/fc7ad0523b414eb288e4e5f388b2f316` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.169374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0140a50-e820-4dc1-9a65-c7a4ae3d7bb2 None admin] RBAC: Authorizing `identity:get_group(group_id=fc7ad0523b414eb288e4e5f388b2f316)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.170892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0140a50-e820-4dc1-9a65-c7a4ae3d7bb2 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:40.172638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 183/381] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:39 2022] GET /identity/v3/groups/fc7ad0523b414eb288e4e5f388b2f316 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:40.179254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8acedb-3a6e-4cdb-a78d-3e258d9a9a42 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.309389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8acedb-3a6e-4cdb-a78d-3e258d9a9a42 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.351387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87768c-8919-4b12-b3cd-353ba9eed1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.352011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87768c-8919-4b12-b3cd-353ba9eed1ea None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.352291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87768c-8919-4b12-b3cd-353ba9eed1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.352565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87768c-8919-4b12-b3cd-353ba9eed1ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.353305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87768c-8919-4b12-b3cd-353ba9eed1ea None admin] RBAC: Adding query filter params (group.id=fc7ad0523b414eb288e4e5f388b2f316, role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=f82c5c1108704750815ed9407c515587) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:40.353610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87768c-8919-4b12-b3cd-353ba9eed1ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.355071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87768c-8919-4b12-b3cd-353ba9eed1ea None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:40.361931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 199/382] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/role_assignments?group.id=fc7ad0523b414eb288e4e5f388b2f316&scope.project.id=f82c5c1108704750815ed9407c515587&role.id=609b1a993a394f0e900e17edccebaea5 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:40.407036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c7895-aae3-45b1-a280-4a9e6c00e719 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.407329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c7895-aae3-45b1-a280-4a9e6c00e719 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.407587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c7895-aae3-45b1-a280-4a9e6c00e719 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.409832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 184/383] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:40.416414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d19fd-2f6d-43c5-8ce4-656c887675f4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.416788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d19fd-2f6d-43c5-8ce4-656c887675f4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.417159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d19fd-2f6d-43c5-8ce4-656c887675f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.437771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-be5d19fd-2f6d-43c5-8ce4-656c887675f4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:40.439138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-be5d19fd-2f6d-43c5-8ce4-656c887675f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:40.461906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:40.526705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 200/384] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:40.580851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c7895-aae3-45b1-a280-4a9e6c00e719 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.695831 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c7895-aae3-45b1-a280-4a9e6c00e719 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.718819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:40.748586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57d02d-68b6-47fd-92c4-4a7b033837ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.749240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57d02d-68b6-47fd-92c4-4a7b033837ea None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.749525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57d02d-68b6-47fd-92c4-4a7b033837ea None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.749805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57d02d-68b6-47fd-92c4-4a7b033837ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.764142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57d02d-68b6-47fd-92c4-4a7b033837ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-6c57d02d-68b6-47fd-92c4-4a7b033837ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:40.769758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:40.770608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:40.771426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:40.773505 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 185/385] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:40.778538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d19fd-2f6d-43c5-8ce4-656c887675f4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.924173 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d19fd-2f6d-43c5-8ce4-656c887675f4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:40.948343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57d02d-68b6-47fd-92c4-4a7b033837ea None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:40.974518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0594d-fd54-41cc-93ca-7574990219a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:40.976954 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0594d-fd54-41cc-93ca-7574990219a0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:40.977628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0594d-fd54-41cc-93ca-7574990219a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:40.978816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0594d-fd54-41cc-93ca-7574990219a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:40.979756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0594d-fd54-41cc-93ca-7574990219a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:40.980473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0594d-fd54-41cc-93ca-7574990219a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:40.982866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0594d-fd54-41cc-93ca-7574990219a0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:41.001307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 201/386] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:41.013466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0594d-fd54-41cc-93ca-7574990219a0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:41.063320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:41.137019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57d02d-68b6-47fd-92c4-4a7b033837ea None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:41.179394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2298a70-5bec-4aeb-af5b-a5847de47be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.179956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2298a70-5bec-4aeb-af5b-a5847de47be5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.180243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2298a70-5bec-4aeb-af5b-a5847de47be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.180520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2298a70-5bec-4aeb-af5b-a5847de47be5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.190417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0594d-fd54-41cc-93ca-7574990219a0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:41.198586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2298a70-5bec-4aeb-af5b-a5847de47be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-f2298a70-5bec-4aeb-af5b-a5847de47be5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:41.203452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:41.204328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:41.205144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:41.209476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 186/387] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:41.212407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2298a70-5bec-4aeb-af5b-a5847de47be5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:41.250648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13cb1-1174-435e-9cee-d8cb4213d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.251609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13cb1-1174-435e-9cee-d8cb4213d64f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.252149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13cb1-1174-435e-9cee-d8cb4213d64f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.252600 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13cb1-1174-435e-9cee-d8cb4213d64f None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.253879 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13cb1-1174-435e-9cee-d8cb4213d64f None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:41.255513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13cb1-1174-435e-9cee-d8cb4213d64f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:41.257580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 202/388] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:41 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:41.264004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13cb1-1174-435e-9cee-d8cb4213d64f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:41.315317 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:41.362253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:41.373843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13cb1-1174-435e-9cee-d8cb4213d64f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:41.442633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29bf80-6068-4106-bf06-c218d08ff5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.443226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29bf80-6068-4106-bf06-c218d08ff5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.443506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29bf80-6068-4106-bf06-c218d08ff5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.443780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29bf80-6068-4106-bf06-c218d08ff5c7 None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.445517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29bf80-6068-4106-bf06-c218d08ff5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:41.446980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29bf80-6068-4106-bf06-c218d08ff5c7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:41.448619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 203/389] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:41 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:41.455181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29bf80-6068-4106-bf06-c218d08ff5c7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:41.459839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2298a70-5bec-4aeb-af5b-a5847de47be5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:41.527642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d9f3-ce03-4432-839d-1e1042e135d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.528271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d9f3-ce03-4432-839d-1e1042e135d0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.528554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d9f3-ce03-4432-839d-1e1042e135d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.528822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d9f3-ce03-4432-839d-1e1042e135d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.529508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96d9f3-ce03-4432-839d-1e1042e135d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:41.529816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96d9f3-ce03-4432-839d-1e1042e135d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:41.531228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96d9f3-ce03-4432-839d-1e1042e135d0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:41.550064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 187/390] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:41.555501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d9f3-ce03-4432-839d-1e1042e135d0 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:41.610076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29bf80-6068-4106-bf06-c218d08ff5c7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:41.662891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28aa4c-a896-4247-b248-c363cfaad92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.663597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28aa4c-a896-4247-b248-c363cfaad92c None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.663877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28aa4c-a896-4247-b248-c363cfaad92c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.664152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28aa4c-a896-4247-b248-c363cfaad92c None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8/groups/8c41fee3a86c4da29fbdfa18eeb266f4/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.666574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28aa4c-a896-4247-b248-c363cfaad92c None admin] RBAC: Authorizing `identity:create_grant(project_id=87d64932a5ad41f8b5467e542488e3c8, group_id=8c41fee3a86c4da29fbdfa18eeb266f4, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:41.667758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28aa4c-a896-4247-b248-c363cfaad92c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:41.686964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 204/391] 10.222.0.89 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:41 2022] PUT /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8/groups/8c41fee3a86c4da29fbdfa18eeb266f4/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:41.686964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31a4ea-f311-47b1-a77d-01b55f20ef69 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.686964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31a4ea-f311-47b1-a77d-01b55f20ef69 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.686964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31a4ea-f311-47b1-a77d-01b55f20ef69 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.686964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 205/392] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:41.693800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04873cf2-21db-4929-9dd4-34c3f3320f8f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.694164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04873cf2-21db-4929-9dd4-34c3f3320f8f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.694570 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04873cf2-21db-4929-9dd4-34c3f3320f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.711992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:41.717461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d9f3-ce03-4432-839d-1e1042e135d0 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:41.719366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-04873cf2-21db-4929-9dd4-34c3f3320f8f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:41.721661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-04873cf2-21db-4929-9dd4-34c3f3320f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:41.732121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:41.759700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ec3f8-aae9-435b-a041-569aa30ba513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.761012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ec3f8-aae9-435b-a041-569aa30ba513 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.761421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ec3f8-aae9-435b-a041-569aa30ba513 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.761886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ec3f8-aae9-435b-a041-569aa30ba513 None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.763179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ec3f8-aae9-435b-a041-569aa30ba513 None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:41.764779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ec3f8-aae9-435b-a041-569aa30ba513 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:41.767905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 188/393] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:41 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:41.777849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ec3f8-aae9-435b-a041-569aa30ba513 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:41.810244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 206/394] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:41.956732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ec3f8-aae9-435b-a041-569aa30ba513 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:41.995229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31c338-03ed-41b7-a050-25a07d5f5082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:41.996394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31c338-03ed-41b7-a050-25a07d5f5082 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:41.996963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31c338-03ed-41b7-a050-25a07d5f5082 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:41.997475 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31c338-03ed-41b7-a050-25a07d5f5082 None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:41.999095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31c338-03ed-41b7-a050-25a07d5f5082 None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:42.001131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31c338-03ed-41b7-a050-25a07d5f5082 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:42.003455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 189/395] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:41 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:42.016389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04873cf2-21db-4929-9dd4-34c3f3320f8f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.110637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31c338-03ed-41b7-a050-25a07d5f5082 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.122016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04873cf2-21db-4929-9dd4-34c3f3320f8f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.149057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:42.162739 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e1e80-7b56-4259-9925-329673641eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:42.163483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e1e80-7b56-4259-9925-329673641eab None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.163761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e1e80-7b56-4259-9925-329673641eab None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.164037 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e1e80-7b56-4259-9925-329673641eab None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8/groups/8c41fee3a86c4da29fbdfa18eeb266f4/roles/88da3cfff1d74296962f08ef7829479c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.166303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e1e80-7b56-4259-9925-329673641eab None admin] RBAC: Authorizing `identity:create_grant(project_id=87d64932a5ad41f8b5467e542488e3c8, group_id=8c41fee3a86c4da29fbdfa18eeb266f4, role_id=88da3cfff1d74296962f08ef7829479c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:42.167761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e1e80-7b56-4259-9925-329673641eab None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:42.195247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 207/396] 10.222.0.89 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:42 2022] PUT /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8/groups/8c41fee3a86c4da29fbdfa18eeb266f4/roles/88da3cfff1d74296962f08ef7829479c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:42.233828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31c338-03ed-41b7-a050-25a07d5f5082 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.259492 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfbad8-4e9e-4151-9c83-bdc678139751 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.260107 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfbad8-4e9e-4151-9c83-bdc678139751 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.260611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfbad8-4e9e-4151-9c83-bdc678139751 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.262451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 208/397] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:42.271930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e44e9d-5d94-4333-b1f4-f56fc54e2c52 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.272530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e44e9d-5d94-4333-b1f4-f56fc54e2c52 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.273028 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e44e9d-5d94-4333-b1f4-f56fc54e2c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.280678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:42.283913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31463de-4c7f-4f5c-a130-aabbfdb47467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:42.284378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31463de-4c7f-4f5c-a130-aabbfdb47467 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.284715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31463de-4c7f-4f5c-a130-aabbfdb47467 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.285144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31463de-4c7f-4f5c-a130-aabbfdb47467 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.300493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-40e44e9d-5d94-4333-b1f4-f56fc54e2c52 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:42.302344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-40e44e9d-5d94-4333-b1f4-f56fc54e2c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:42.335071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31463de-4c7f-4f5c-a130-aabbfdb47467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-e31463de-4c7f-4f5c-a130-aabbfdb47467 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:42.346000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:42.347071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:42.347876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:42.363467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 190/398] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:42.370080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31463de-4c7f-4f5c-a130-aabbfdb47467 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.439445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 209/399] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:42.515204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31463de-4c7f-4f5c-a130-aabbfdb47467 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.520604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:42.564713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f5022-d5ce-457f-8cea-568b50d6284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:42.565721 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f5022-d5ce-457f-8cea-568b50d6284a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.566220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f5022-d5ce-457f-8cea-568b50d6284a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.566496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f5022-d5ce-457f-8cea-568b50d6284a None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.567389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f5022-d5ce-457f-8cea-568b50d6284a None admin] RBAC: Adding query filter params (name=member) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:42.567706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f5022-d5ce-457f-8cea-568b50d6284a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:42.569105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f5022-d5ce-457f-8cea-568b50d6284a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:42.583107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 191/400] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:42.584355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e44e9d-5d94-4333-b1f4-f56fc54e2c52 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.730785 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e44e9d-5d94-4333-b1f4-f56fc54e2c52 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.781238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f5022-d5ce-457f-8cea-568b50d6284a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.783959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:42.803410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70620e-7fe0-4c8c-bd97-8c1180d06aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:42.804071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70620e-7fe0-4c8c-bd97-8c1180d06aba None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.804351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70620e-7fe0-4c8c-bd97-8c1180d06aba None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.804627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70620e-7fe0-4c8c-bd97-8c1180d06aba None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.806474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70620e-7fe0-4c8c-bd97-8c1180d06aba None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:42.807952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70620e-7fe0-4c8c-bd97-8c1180d06aba None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:42.813010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 210/401] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:42.814875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e552b-d9c1-44c2-8bc0-805e8fc0d2cd None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.815245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e552b-d9c1-44c2-8bc0-805e8fc0d2cd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.815527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e552b-d9c1-44c2-8bc0-805e8fc0d2cd None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.818165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 211/402] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:42.818896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e552b-d9c1-44c2-8bc0-805e8fc0d2cd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:42.936696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e552b-d9c1-44c2-8bc0-805e8fc0d2cd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.947644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f5022-d5ce-457f-8cea-568b50d6284a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:42.972169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056ada4-aa11-49b2-8bf8-5d1cb6676c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:42.972799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ada4-aa11-49b2-8bf8-5d1cb6676c4f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.973073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ada4-aa11-49b2-8bf8-5d1cb6676c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.973345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ada4-aa11-49b2-8bf8-5d1cb6676c4f None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.974527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056ada4-aa11-49b2-8bf8-5d1cb6676c4f None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:42.976062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056ada4-aa11-49b2-8bf8-5d1cb6676c4f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:42.977594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 212/403] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:42.978966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06ece-f609-4ad0-aba5-91c7ecca4090 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:42.979249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06ece-f609-4ad0-aba5-91c7ecca4090 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:42.979521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06ece-f609-4ad0-aba5-91c7ecca4090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:42.997959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2db06ece-f609-4ad0-aba5-91c7ecca4090 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:42.999192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2db06ece-f609-4ad0-aba5-91c7ecca4090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:43.006274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b5750-49cf-4e46-b467-5f3bd3b51d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.007566 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b5750-49cf-4e46-b467-5f3bd3b51d4e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.008144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b5750-49cf-4e46-b467-5f3bd3b51d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.008738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b5750-49cf-4e46-b467-5f3bd3b51d4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.024464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b5750-49cf-4e46-b467-5f3bd3b51d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-dc5b5750-49cf-4e46-b467-5f3bd3b51d4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:43.033223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:43.034250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:43.035450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:43.039116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 192/404] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:43.040654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b5750-49cf-4e46-b467-5f3bd3b51d4e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.064953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.071294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.071680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 213/405] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:43.073363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06ece-f609-4ad0-aba5-91c7ecca4090 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.188760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b5750-49cf-4e46-b467-5f3bd3b51d4e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.218002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06ece-f609-4ad0-aba5-91c7ecca4090 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.239296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa7b37-ef67-434d-968e-8334280b52f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.240612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7b37-ef67-434d-968e-8334280b52f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.241330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7b37-ef67-434d-968e-8334280b52f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.241915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa7b37-ef67-434d-968e-8334280b52f6 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/groups/8c41fee3a86c4da29fbdfa18eeb266f4/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.244819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa7b37-ef67-434d-968e-8334280b52f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c44eb0d46964399b792c9cc7986a2f8, group_id=8c41fee3a86c4da29fbdfa18eeb266f4, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.251642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa7b37-ef67-434d-968e-8334280b52f6 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.255370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd289c67-3de6-4cd0-b668-f4a4efdb7810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.255994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd289c67-3de6-4cd0-b668-f4a4efdb7810 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.256362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd289c67-3de6-4cd0-b668-f4a4efdb7810 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.256535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd289c67-3de6-4cd0-b668-f4a4efdb7810 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.257178 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd289c67-3de6-4cd0-b668-f4a4efdb7810 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:43.257474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd289c67-3de6-4cd0-b668-f4a4efdb7810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.258976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd289c67-3de6-4cd0-b668-f4a4efdb7810 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.269414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 214/406] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:43.275272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd289c67-3de6-4cd0-b668-f4a4efdb7810 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.290477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 193/407] 10.222.0.89 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:43 2022] PUT /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/groups/8c41fee3a86c4da29fbdfa18eeb266f4/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:43.343481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.392538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd289c67-3de6-4cd0-b668-f4a4efdb7810 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.433699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d73a1-1735-4a17-80b9-540be6e29c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.434344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d73a1-1735-4a17-80b9-540be6e29c79 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.434623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d73a1-1735-4a17-80b9-540be6e29c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.434893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d73a1-1735-4a17-80b9-540be6e29c79 None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.436153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d73a1-1735-4a17-80b9-540be6e29c79 None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.437629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d73a1-1735-4a17-80b9-540be6e29c79 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.443062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 215/408] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:43.445326 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa7b37-ef67-434d-968e-8334280b52f6 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.487015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d73a1-1735-4a17-80b9-540be6e29c79 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.534686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.570067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa7b37-ef67-434d-968e-8334280b52f6 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.618923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d73a1-1735-4a17-80b9-540be6e29c79 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.632115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0857-ca52-4c34-a527-ff7ea225d0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.632972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0857-ca52-4c34-a527-ff7ea225d0af None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.633362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0857-ca52-4c34-a527-ff7ea225d0af None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.633687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c0857-ca52-4c34-a527-ff7ea225d0af None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.643992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c0857-ca52-4c34-a527-ff7ea225d0af None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.645978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c0857-ca52-4c34-a527-ff7ea225d0af None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.647254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:43.648640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 194/409] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:43.656315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0857-ca52-4c34-a527-ff7ea225d0af None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.669111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1892-6544-4331-8d94-a767a11f5281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.669976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1892-6544-4331-8d94-a767a11f5281 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.670316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1892-6544-4331-8d94-a767a11f5281 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.670775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1892-6544-4331-8d94-a767a11f5281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.715758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f1892-6544-4331-8d94-a767a11f5281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-194f1892-6544-4331-8d94-a767a11f5281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:43.723414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:43.724467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:43.725285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 216/410] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:43.736932 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1892-6544-4331-8d94-a767a11f5281 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:43.766259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c0857-ca52-4c34-a527-ff7ea225d0af None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.802760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d39c2-2ba5-4680-b15c-7516ed798a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.803467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d39c2-2ba5-4680-b15c-7516ed798a13 None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:43.803749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d39c2-2ba5-4680-b15c-7516ed798a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:43.804023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d39c2-2ba5-4680-b15c-7516ed798a13 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/groups/8c41fee3a86c4da29fbdfa18eeb266f4/roles/88da3cfff1d74296962f08ef7829479c` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:43.806226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d39c2-2ba5-4680-b15c-7516ed798a13 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c44eb0d46964399b792c9cc7986a2f8, group_id=8c41fee3a86c4da29fbdfa18eeb266f4, role_id=88da3cfff1d74296962f08ef7829479c)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:43.808167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d39c2-2ba5-4680-b15c-7516ed798a13 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:43.827199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 195/411] 10.222.0.89 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:43 2022] PUT /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8/groups/8c41fee3a86c4da29fbdfa18eeb266f4/roles/88da3cfff1d74296962f08ef7829479c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:26:43.959086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1892-6544-4331-8d94-a767a11f5281 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:43.999229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839a4b2-4d70-4a64-8c1c-f2a6a94bc057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:43.999839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a4b2-4d70-4a64-8c1c-f2a6a94bc057 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.000117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a4b2-4d70-4a64-8c1c-f2a6a94bc057 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.000391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a4b2-4d70-4a64-8c1c-f2a6a94bc057 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.001066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839a4b2-4d70-4a64-8c1c-f2a6a94bc057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:44.001447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839a4b2-4d70-4a64-8c1c-f2a6a94bc057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:44.003075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839a4b2-4d70-4a64-8c1c-f2a6a94bc057 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:44.020004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 217/412] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:44.026354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d39c2-2ba5-4680-b15c-7516ed798a13 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.035150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:44.141701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d39c2-2ba5-4680-b15c-7516ed798a13 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:44.178186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567b785-cd8d-4292-b71f-4a4e992d4081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:44.178824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b785-cd8d-4292-b71f-4a4e992d4081 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.179134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b785-cd8d-4292-b71f-4a4e992d4081 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.179407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b785-cd8d-4292-b71f-4a4e992d4081 None admin] PATH_INFO: `/v3/groups/fc7ad0523b414eb288e4e5f388b2f316` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.180528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567b785-cd8d-4292-b71f-4a4e992d4081 None admin] RBAC: Authorizing `identity:get_group(group_id=fc7ad0523b414eb288e4e5f388b2f316)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:44.181967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567b785-cd8d-4292-b71f-4a4e992d4081 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:44.183913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 196/413] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:44 2022] GET /identity/v3/groups/fc7ad0523b414eb288e4e5f388b2f316 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:44.191395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839a4b2-4d70-4a64-8c1c-f2a6a94bc057 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.242605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:44.281958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7047f65-9954-4838-9ba1-918b2f8ed8fd None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.282624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7047f65-9954-4838-9ba1-918b2f8ed8fd None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.283115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7047f65-9954-4838-9ba1-918b2f8ed8fd None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.284638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 197/414] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:44.289695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce634ffa-45e2-422c-a178-fd978540b6f5 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.290175 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce634ffa-45e2-422c-a178-fd978540b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.290617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce634ffa-45e2-422c-a178-fd978540b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.306975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839a4b2-4d70-4a64-8c1c-f2a6a94bc057 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:44.323141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ce634ffa-45e2-422c-a178-fd978540b6f5 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:44.324358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ce634ffa-45e2-422c-a178-fd978540b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:44.349191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c774771-6f62-4b1b-8e70-500f9b8481fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:44.350160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774771-6f62-4b1b-8e70-500f9b8481fb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.351429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774771-6f62-4b1b-8e70-500f9b8481fb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.351890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774771-6f62-4b1b-8e70-500f9b8481fb None admin] PATH_INFO: `/v3/projects/f82c5c1108704750815ed9407c515587` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.354953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c774771-6f62-4b1b-8e70-500f9b8481fb None admin] RBAC: Authorizing `identity:get_project(project_id=f82c5c1108704750815ed9407c515587)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:44.356584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c774771-6f62-4b1b-8e70-500f9b8481fb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:44.360395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 218/415] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:44 2022] GET /identity/v3/projects/f82c5c1108704750815ed9407c515587 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:44.367553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c774771-6f62-4b1b-8e70-500f9b8481fb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.480555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 198/416] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:44.515259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c774771-6f62-4b1b-8e70-500f9b8481fb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:44.539333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:44.550909 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e881988-786f-49f9-b7c4-66cf00ba552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:44.551903 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e881988-786f-49f9-b7c4-66cf00ba552e None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.552418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e881988-786f-49f9-b7c4-66cf00ba552e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.552872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e881988-786f-49f9-b7c4-66cf00ba552e None admin] PATH_INFO: `/v3/projects/f82c5c1108704750815ed9407c515587/groups/fc7ad0523b414eb288e4e5f388b2f316/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.555088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e881988-786f-49f9-b7c4-66cf00ba552e None admin] RBAC: Authorizing `identity:create_grant(project_id=f82c5c1108704750815ed9407c515587, group_id=fc7ad0523b414eb288e4e5f388b2f316, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:44.556827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e881988-786f-49f9-b7c4-66cf00ba552e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:44.575505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 219/417] 10.222.0.89 () {58 vars in 1442 bytes} [Fri Aug 26 15:26:44 2022] PUT /identity/v3/projects/f82c5c1108704750815ed9407c515587/groups/fc7ad0523b414eb288e4e5f388b2f316/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:26:44.787125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cdc10-8aaa-433b-85fa-de8c6ee760c0 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.787859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cdc10-8aaa-433b-85fa-de8c6ee760c0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.788349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cdc10-8aaa-433b-85fa-de8c6ee760c0 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.790411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 199/418] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:44.795887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68da6-e4d6-4a51-98f9-4ba2be75dad9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:44.796204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68da6-e4d6-4a51-98f9-4ba2be75dad9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:44.796443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d68da6-e4d6-4a51-98f9-4ba2be75dad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:44.817691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-27d68da6-e4d6-4a51-98f9-4ba2be75dad9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:44.818880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-27d68da6-e4d6-4a51-98f9-4ba2be75dad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:44.852928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cdc10-8aaa-433b-85fa-de8c6ee760c0 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:44.856078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:44.898733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 220/419] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:44.998541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cdc10-8aaa-433b-85fa-de8c6ee760c0 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.033699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f01b-5292-4575-9e79-9d3c77b29287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.034340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f01b-5292-4575-9e79-9d3c77b29287 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.034623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f01b-5292-4575-9e79-9d3c77b29287 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.034899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f01b-5292-4575-9e79-9d3c77b29287 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.045728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f01b-5292-4575-9e79-9d3c77b29287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-2655f01b-5292-4575-9e79-9d3c77b29287 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:45.051110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:45.051971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:45.052886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 200/420] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:45.060439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68da6-e4d6-4a51-98f9-4ba2be75dad9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.216041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d68da6-e4d6-4a51-98f9-4ba2be75dad9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.233364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:45.280623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc62255-120e-4677-860d-8481eaa47c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.281940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc62255-120e-4677-860d-8481eaa47c78 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.283345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc62255-120e-4677-860d-8481eaa47c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.284076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc62255-120e-4677-860d-8481eaa47c78 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.285358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc62255-120e-4677-860d-8481eaa47c78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:45.285981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc62255-120e-4677-860d-8481eaa47c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:45.288266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc62255-120e-4677-860d-8481eaa47c78 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:45.301834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 221/421] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:45.307058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f01b-5292-4575-9e79-9d3c77b29287 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.320867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc62255-120e-4677-860d-8481eaa47c78 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.466394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:45.477540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc62255-120e-4677-860d-8481eaa47c78 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.519351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50852-d09f-44af-900e-cce52c07c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.520353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50852-d09f-44af-900e-cce52c07c201 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.521002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50852-d09f-44af-900e-cce52c07c201 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.521659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b50852-d09f-44af-900e-cce52c07c201 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.535603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b50852-d09f-44af-900e-cce52c07c201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:45.535994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f01b-5292-4575-9e79-9d3c77b29287 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e7b50852-d09f-44af-900e-cce52c07c201 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:45.544565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:45.545741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:45.547514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:45.550854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 222/422] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:26:45.558734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50852-d09f-44af-900e-cce52c07c201 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.600345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc054ad-1025-40b7-aad6-b833bc623262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.601110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc054ad-1025-40b7-aad6-b833bc623262 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.601398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc054ad-1025-40b7-aad6-b833bc623262 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.601862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc054ad-1025-40b7-aad6-b833bc623262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.606194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:45.737032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc054ad-1025-40b7-aad6-b833bc623262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:45.739758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc054ad-1025-40b7-aad6-b833bc623262 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:45.747060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b50852-d09f-44af-900e-cce52c07c201 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.817427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43969e-e045-42ec-866a-29d6e5dcbc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.818360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43969e-e045-42ec-866a-29d6e5dcbc41 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.818843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43969e-e045-42ec-866a-29d6e5dcbc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.819348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43969e-e045-42ec-866a-29d6e5dcbc41 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.820220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43969e-e045-42ec-866a-29d6e5dcbc41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:45.820731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43969e-e045-42ec-866a-29d6e5dcbc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:45.822297 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43969e-e045-42ec-866a-29d6e5dcbc41 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:45.831366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 223/423] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:45.833030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb4d0c-d0ca-4c34-968c-84af394b3718 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.833509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb4d0c-d0ca-4c34-968c-84af394b3718 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.833996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb4d0c-d0ca-4c34-968c-84af394b3718 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.837468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:45.839420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 224/424] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:45.840381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb4d0c-d0ca-4c34-968c-84af394b3718 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.882375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 201/425] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:45.884297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8ab7-d17c-4ef7-8afd-7cbbd3afe798 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.884806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8ab7-d17c-4ef7-8afd-7cbbd3afe798 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.885296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8ab7-d17c-4ef7-8afd-7cbbd3afe798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:45.904052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ccae8ab7-d17c-4ef7-8afd-7cbbd3afe798 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:45.905557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ccae8ab7-d17c-4ef7-8afd-7cbbd3afe798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:45.936825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:45.947543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb4d0c-d0ca-4c34-968c-84af394b3718 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:45.981816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81907c-fd7d-4020-8d07-b74471caf01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:45.982476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81907c-fd7d-4020-8d07-b74471caf01b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:45.982693 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81907c-fd7d-4020-8d07-b74471caf01b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:45.983137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 202/426] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:45.984189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8ab7-d17c-4ef7-8afd-7cbbd3afe798 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:45.987266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81907c-fd7d-4020-8d07-b74471caf01b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.058363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81907c-fd7d-4020-8d07-b74471caf01b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.059646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81907c-fd7d-4020-8d07-b74471caf01b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.084810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.095967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8ab7-d17c-4ef7-8afd-7cbbd3afe798 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.145856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad4409-5f25-4690-a172-20a3dc738348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.146869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad4409-5f25-4690-a172-20a3dc738348 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.147402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad4409-5f25-4690-a172-20a3dc738348 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.148000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad4409-5f25-4690-a172-20a3dc738348 None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.151729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad4409-5f25-4690-a172-20a3dc738348 None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.153515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad4409-5f25-4690-a172-20a3dc738348 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.155789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 203/427] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:45 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:46.161358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad4409-5f25-4690-a172-20a3dc738348 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.208594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.221756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 225/428] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:46.231919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81907c-fd7d-4020-8d07-b74471caf01b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.286850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad4409-5f25-4690-a172-20a3dc738348 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.322313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f942827-d72e-40dd-ada8-4f2a662c26d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.323396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f942827-d72e-40dd-ada8-4f2a662c26d5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.323884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f942827-d72e-40dd-ada8-4f2a662c26d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.324428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f942827-d72e-40dd-ada8-4f2a662c26d5 None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.325946 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f942827-d72e-40dd-ada8-4f2a662c26d5 None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.327641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f942827-d72e-40dd-ada8-4f2a662c26d5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.330162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 204/429] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:46.336278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a000118-2a94-4808-b477-6b6a949b16c5 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.337079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a000118-2a94-4808-b477-6b6a949b16c5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.337632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a000118-2a94-4808-b477-6b6a949b16c5 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.339178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 205/430] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:46.340093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a000118-2a94-4808-b477-6b6a949b16c5 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.373383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.378359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81907c-fd7d-4020-8d07-b74471caf01b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.417935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30d955-d39d-4f1c-9fe1-ca82f96bf33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.418729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30d955-d39d-4f1c-9fe1-ca82f96bf33c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.419092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30d955-d39d-4f1c-9fe1-ca82f96bf33c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.419465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30d955-d39d-4f1c-9fe1-ca82f96bf33c None admin] PATH_INFO: `/v3/projects/87d64932a5ad41f8b5467e542488e3c8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.420853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30d955-d39d-4f1c-9fe1-ca82f96bf33c None admin] RBAC: Authorizing `identity:get_project(project_id=87d64932a5ad41f8b5467e542488e3c8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.422642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30d955-d39d-4f1c-9fe1-ca82f96bf33c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.424665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 226/431] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/projects/87d64932a5ad41f8b5467e542488e3c8 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:46.429182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa328d3-6730-41f4-a986-142aa2ae0a11 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.429182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa328d3-6730-41f4-a986-142aa2ae0a11 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.429182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa328d3-6730-41f4-a986-142aa2ae0a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.447600 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9aa328d3-6730-41f4-a986-142aa2ae0a11 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:46.448965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9aa328d3-6730-41f4-a986-142aa2ae0a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:46.463446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a000118-2a94-4808-b477-6b6a949b16c5 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.503816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ef462-eaa2-4b66-8ced-29f232cefea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.504544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ef462-eaa2-4b66-8ced-29f232cefea1 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.504890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ef462-eaa2-4b66-8ced-29f232cefea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.505217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ef462-eaa2-4b66-8ced-29f232cefea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.506636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ef462-eaa2-4b66-8ced-29f232cefea1 None admin] RBAC: Adding query filter params (group.id=8c41fee3a86c4da29fbdfa18eeb266f4, role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=87d64932a5ad41f8b5467e542488e3c8) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:46.507061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ef462-eaa2-4b66-8ced-29f232cefea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.508882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ef462-eaa2-4b66-8ced-29f232cefea1 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.512898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.517661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 206/432] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/role_assignments?group.id=8c41fee3a86c4da29fbdfa18eeb266f4&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=79bef6f5048d441d883bb015c7887170 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:46.518624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ef462-eaa2-4b66-8ced-29f232cefea1 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.547036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 227/433] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:46.547036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa328d3-6730-41f4-a986-142aa2ae0a11 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.687888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa328d3-6730-41f4-a986-142aa2ae0a11 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.719429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.731389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071fa8-3868-4f39-ae6a-9785722f3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.732033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071fa8-3868-4f39-ae6a-9785722f3b25 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.732311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071fa8-3868-4f39-ae6a-9785722f3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.732584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071fa8-3868-4f39-ae6a-9785722f3b25 None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.733628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ef462-eaa2-4b66-8ced-29f232cefea1 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.733737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071fa8-3868-4f39-ae6a-9785722f3b25 None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.736704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071fa8-3868-4f39-ae6a-9785722f3b25 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.738469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 228/434] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:46.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071fa8-3868-4f39-ae6a-9785722f3b25 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.785950 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb3984-a0da-46e1-a59b-3ba095d96127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.786596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb3984-a0da-46e1-a59b-3ba095d96127 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.786875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb3984-a0da-46e1-a59b-3ba095d96127 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.787190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb3984-a0da-46e1-a59b-3ba095d96127 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.812598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb3984-a0da-46e1-a59b-3ba095d96127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-b7bb3984-a0da-46e1-a59b-3ba095d96127 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:46.820711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:46.821614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 15:26:46.822447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:46.824506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 207/435] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:46.830345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb3984-a0da-46e1-a59b-3ba095d96127 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.830512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:46.889243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071fa8-3868-4f39-ae6a-9785722f3b25 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.933428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787d86-dbfa-4565-b1ae-ff5e909fa811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.934579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787d86-dbfa-4565-b1ae-ff5e909fa811 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.934787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787d86-dbfa-4565-b1ae-ff5e909fa811 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.935358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787d86-dbfa-4565-b1ae-ff5e909fa811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.936106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e787d86-dbfa-4565-b1ae-ff5e909fa811 None admin] RBAC: Adding query filter params (group.id=8c41fee3a86c4da29fbdfa18eeb266f4, role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=87d64932a5ad41f8b5467e542488e3c8) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:46.936577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e787d86-dbfa-4565-b1ae-ff5e909fa811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.939631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e787d86-dbfa-4565-b1ae-ff5e909fa811 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:46.946153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb3984-a0da-46e1-a59b-3ba095d96127 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:46.946685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 229/436] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/role_assignments?group.id=8c41fee3a86c4da29fbdfa18eeb266f4&scope.project.id=87d64932a5ad41f8b5467e542488e3c8&role.id=88da3cfff1d74296962f08ef7829479c => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:46.948143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050468d7-bdd2-4bb4-9411-0ecc01e4259f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.948435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050468d7-bdd2-4bb4-9411-0ecc01e4259f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.948710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050468d7-bdd2-4bb4-9411-0ecc01e4259f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.950777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 230/437] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:46.951573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050468d7-bdd2-4bb4-9411-0ecc01e4259f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:46.988777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5e6b5-2d2f-452e-b3d7-b0f2e35b74a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:46.989403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5e6b5-2d2f-452e-b3d7-b0f2e35b74a8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:46.989690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5e6b5-2d2f-452e-b3d7-b0f2e35b74a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:46.989956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5e6b5-2d2f-452e-b3d7-b0f2e35b74a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:46.991483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5e6b5-2d2f-452e-b3d7-b0f2e35b74a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:46.991483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5e6b5-2d2f-452e-b3d7-b0f2e35b74a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:46.992416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5e6b5-2d2f-452e-b3d7-b0f2e35b74a8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.003867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 208/438] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:47.005000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7b323-c2b6-4a94-b257-e6e1180b3725 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.005294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7b323-c2b6-4a94-b257-e6e1180b3725 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.005565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7b323-c2b6-4a94-b257-e6e1180b3725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.028759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-01b7b323-c2b6-4a94-b257-e6e1180b3725 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:47.029996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-01b7b323-c2b6-4a94-b257-e6e1180b3725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:47.042187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.123912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050468d7-bdd2-4bb4-9411-0ecc01e4259f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.129876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 209/439] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:47.130519 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7b323-c2b6-4a94-b257-e6e1180b3725 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.152588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.167341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec680ca-92b4-4a61-a822-5e74d874afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.167983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec680ca-92b4-4a61-a822-5e74d874afde None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.168413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec680ca-92b4-4a61-a822-5e74d874afde None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.168632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec680ca-92b4-4a61-a822-5e74d874afde None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.185931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec680ca-92b4-4a61-a822-5e74d874afde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-eec680ca-92b4-4a61-a822-5e74d874afde None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:47.191480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:47.192363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:47.193210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 231/440] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:47.198753 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec680ca-92b4-4a61-a822-5e74d874afde None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.262883 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7b323-c2b6-4a94-b257-e6e1180b3725 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.309682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7aa9a-4097-477c-bdce-c65cea1c41ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.310354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7aa9a-4097-477c-bdce-c65cea1c41ab None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.310632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7aa9a-4097-477c-bdce-c65cea1c41ab None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.310905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7aa9a-4097-477c-bdce-c65cea1c41ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.330695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.338438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec680ca-92b4-4a61-a822-5e74d874afde None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.379172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22dda7-7882-4873-bcdd-aaf32c8c3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.379789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22dda7-7882-4873-bcdd-aaf32c8c3a29 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.380069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22dda7-7882-4873-bcdd-aaf32c8c3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.380345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22dda7-7882-4873-bcdd-aaf32c8c3a29 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.381012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22dda7-7882-4873-bcdd-aaf32c8c3a29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:47.381316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22dda7-7882-4873-bcdd-aaf32c8c3a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.382688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22dda7-7882-4873-bcdd-aaf32c8c3a29 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.397135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 232/441] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:47.398281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7aa9a-4097-477c-bdce-c65cea1c41ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.400057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7aa9a-4097-477c-bdce-c65cea1c41ab None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.403047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22dda7-7882-4873-bcdd-aaf32c8c3a29 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.460045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.508155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 210/442] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:47.509060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7aa9a-4097-477c-bdce-c65cea1c41ab None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.521461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22dda7-7882-4873-bcdd-aaf32c8c3a29 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.553513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.556268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5744b68-822a-4b35-8bf8-4d137ac75119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.556875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5744b68-822a-4b35-8bf8-4d137ac75119 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.557152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5744b68-822a-4b35-8bf8-4d137ac75119 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.557429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5744b68-822a-4b35-8bf8-4d137ac75119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.610720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7aa9a-4097-477c-bdce-c65cea1c41ab None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.624871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5744b68-822a-4b35-8bf8-4d137ac75119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.626360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5744b68-822a-4b35-8bf8-4d137ac75119 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.644445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357521e-1dcc-47c4-9cc2-ed3cb54317b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.645064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357521e-1dcc-47c4-9cc2-ed3cb54317b9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.645345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357521e-1dcc-47c4-9cc2-ed3cb54317b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.645626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357521e-1dcc-47c4-9cc2-ed3cb54317b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.656016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357521e-1dcc-47c4-9cc2-ed3cb54317b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-a357521e-1dcc-47c4-9cc2-ed3cb54317b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:47.660800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:47.661670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:47.662459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 211/443] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:47.663469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357521e-1dcc-47c4-9cc2-ed3cb54317b9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.669744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.732078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 233/444] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:47.732868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5744b68-822a-4b35-8bf8-4d137ac75119 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.770586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357521e-1dcc-47c4-9cc2-ed3cb54317b9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.772893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.805598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56f2c7-1e40-4988-b688-5d516efd34a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.806225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56f2c7-1e40-4988-b688-5d516efd34a0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.806501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56f2c7-1e40-4988-b688-5d516efd34a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.806773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56f2c7-1e40-4988-b688-5d516efd34a0 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.807984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56f2c7-1e40-4988-b688-5d516efd34a0 None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.809404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56f2c7-1e40-4988-b688-5d516efd34a0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.811054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 212/445] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:47.811801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56f2c7-1e40-4988-b688-5d516efd34a0 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.831499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5744b68-822a-4b35-8bf8-4d137ac75119 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.864879 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197733b-845c-43f9-85f4-09a843e513bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.865484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197733b-845c-43f9-85f4-09a843e513bb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.865766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197733b-845c-43f9-85f4-09a843e513bb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.866038 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197733b-845c-43f9-85f4-09a843e513bb None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.866712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197733b-845c-43f9-85f4-09a843e513bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:47.867042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197733b-845c-43f9-85f4-09a843e513bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.868417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197733b-845c-43f9-85f4-09a843e513bb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.876636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 234/446] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:47.877178 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197733b-845c-43f9-85f4-09a843e513bb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.885552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:47.915528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56f2c7-1e40-4988-b688-5d516efd34a0 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:47.951285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1296b-6230-48f6-9101-7f3185c33ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:47.952003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1296b-6230-48f6-9101-7f3185c33ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:47.952292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1296b-6230-48f6-9101-7f3185c33ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:47.952563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1296b-6230-48f6-9101-7f3185c33ba5 None admin] PATH_INFO: `/v3/projects/0c44eb0d46964399b792c9cc7986a2f8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:47.953804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1296b-6230-48f6-9101-7f3185c33ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=0c44eb0d46964399b792c9cc7986a2f8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:47.955443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1296b-6230-48f6-9101-7f3185c33ba5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:47.957208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 213/447] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/projects/0c44eb0d46964399b792c9cc7986a2f8 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:47.958016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1296b-6230-48f6-9101-7f3185c33ba5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:47.980901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197733b-845c-43f9-85f4-09a843e513bb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.003247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.014909 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3672974-862b-4c40-ad8a-cf1157f7cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.015570 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3672974-862b-4c40-ad8a-cf1157f7cefc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.016113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3672974-862b-4c40-ad8a-cf1157f7cefc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.016382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3672974-862b-4c40-ad8a-cf1157f7cefc None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.017493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3672974-862b-4c40-ad8a-cf1157f7cefc None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.018918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3672974-862b-4c40-ad8a-cf1157f7cefc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.020495 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 235/448] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.021238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3672974-862b-4c40-ad8a-cf1157f7cefc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.066194 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1296b-6230-48f6-9101-7f3185c33ba5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.093161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.101451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d0d79-cc92-44a6-b6cf-1c2929e3964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.102070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0d79-cc92-44a6-b6cf-1c2929e3964f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.102354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0d79-cc92-44a6-b6cf-1c2929e3964f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.102632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d0d79-cc92-44a6-b6cf-1c2929e3964f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.118752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3672974-862b-4c40-ad8a-cf1157f7cefc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.151517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360285d-3dfc-494c-9b04-bfc74806bdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.152154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360285d-3dfc-494c-9b04-bfc74806bdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.152482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360285d-3dfc-494c-9b04-bfc74806bdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.152690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360285d-3dfc-494c-9b04-bfc74806bdf9 None admin] PATH_INFO: `/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.153811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360285d-3dfc-494c-9b04-bfc74806bdf9 None admin] RBAC: Authorizing `identity:get_group(group_id=8c41fee3a86c4da29fbdfa18eeb266f4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.155266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360285d-3dfc-494c-9b04-bfc74806bdf9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.156817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 236/449] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/groups/8c41fee3a86c4da29fbdfa18eeb266f4 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.159401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360285d-3dfc-494c-9b04-bfc74806bdf9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.175179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d0d79-cc92-44a6-b6cf-1c2929e3964f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.176637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d0d79-cc92-44a6-b6cf-1c2929e3964f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.215904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.259836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360285d-3dfc-494c-9b04-bfc74806bdf9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.279680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 214/450] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:48.280556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d0d79-cc92-44a6-b6cf-1c2929e3964f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.296566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ca6b1-39cd-4a11-b358-cc6bb8211036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.297189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ca6b1-39cd-4a11-b358-cc6bb8211036 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.297473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ca6b1-39cd-4a11-b358-cc6bb8211036 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.297747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ca6b1-39cd-4a11-b358-cc6bb8211036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.298473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ca6b1-39cd-4a11-b358-cc6bb8211036 None admin] RBAC: Adding query filter params (group.id=8c41fee3a86c4da29fbdfa18eeb266f4, role.id=79bef6f5048d441d883bb015c7887170, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:48.298780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ca6b1-39cd-4a11-b358-cc6bb8211036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.300246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ca6b1-39cd-4a11-b358-cc6bb8211036 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.305807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 237/451] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/role_assignments?group.id=8c41fee3a86c4da29fbdfa18eeb266f4&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=79bef6f5048d441d883bb015c7887170 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.306573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ca6b1-39cd-4a11-b358-cc6bb8211036 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.319159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.392335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d0d79-cc92-44a6-b6cf-1c2929e3964f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.415374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ca6b1-39cd-4a11-b358-cc6bb8211036 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.430790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a738331-4b4e-4376-9688-084c4b8a996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.431725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a738331-4b4e-4376-9688-084c4b8a996c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.432149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a738331-4b4e-4376-9688-084c4b8a996c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.432698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a738331-4b4e-4376-9688-084c4b8a996c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.433700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a738331-4b4e-4376-9688-084c4b8a996c None admin] RBAC: Adding query filter params (group.id=8c41fee3a86c4da29fbdfa18eeb266f4, role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=0c44eb0d46964399b792c9cc7986a2f8) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:48.434170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a738331-4b4e-4376-9688-084c4b8a996c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.435822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a738331-4b4e-4376-9688-084c4b8a996c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.443241 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 215/452] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/role_assignments?group.id=8c41fee3a86c4da29fbdfa18eeb266f4&scope.project.id=0c44eb0d46964399b792c9cc7986a2f8&role.id=88da3cfff1d74296962f08ef7829479c => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.450756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cec14-4b8c-4f09-a1fb-f6afc2542c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.451535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cec14-4b8c-4f09-a1fb-f6afc2542c5e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.451817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cec14-4b8c-4f09-a1fb-f6afc2542c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.452087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cec14-4b8c-4f09-a1fb-f6afc2542c5e None admin] PATH_INFO: `/v3/projects/f82c5c1108704750815ed9407c515587` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.453288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cec14-4b8c-4f09-a1fb-f6afc2542c5e None admin] RBAC: Authorizing `identity:get_project(project_id=f82c5c1108704750815ed9407c515587)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.455536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cec14-4b8c-4f09-a1fb-f6afc2542c5e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.457522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 238/453] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/projects/f82c5c1108704750815ed9407c515587 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:48.463735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a738331-4b4e-4376-9688-084c4b8a996c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.468341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.584886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a738331-4b4e-4376-9688-084c4b8a996c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.621573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbeab3-d24b-45fd-8a3c-c65096b5264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.622212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbeab3-d24b-45fd-8a3c-c65096b5264a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.622491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbeab3-d24b-45fd-8a3c-c65096b5264a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.622762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbeab3-d24b-45fd-8a3c-c65096b5264a None admin] PATH_INFO: `/v3/groups/fc7ad0523b414eb288e4e5f388b2f316` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.623953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbeab3-d24b-45fd-8a3c-c65096b5264a None admin] RBAC: Authorizing `identity:get_group(group_id=fc7ad0523b414eb288e4e5f388b2f316)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.625382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbeab3-d24b-45fd-8a3c-c65096b5264a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.627802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 216/454] 10.222.0.89 () {56 vars in 1180 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/groups/fc7ad0523b414eb288e4e5f388b2f316 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:48.633736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cec14-4b8c-4f09-a1fb-f6afc2542c5e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:48.716841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:48.741837 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cec14-4b8c-4f09-a1fb-f6afc2542c5e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:48.776184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27293c6-622e-417d-9eb9-5def1762e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:48.776800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27293c6-622e-417d-9eb9-5def1762e925 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:48.777083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27293c6-622e-417d-9eb9-5def1762e925 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:48.777354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27293c6-622e-417d-9eb9-5def1762e925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:48.778091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27293c6-622e-417d-9eb9-5def1762e925 None admin] RBAC: Adding query filter params (group.id=fc7ad0523b414eb288e4e5f388b2f316, role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=f82c5c1108704750815ed9407c515587) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:48.778395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27293c6-622e-417d-9eb9-5def1762e925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:48.779881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27293c6-622e-417d-9eb9-5def1762e925 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:48.787922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 239/455] 10.222.0.89 () {56 vars in 1376 bytes} [Fri Aug 26 15:26:48 2022] GET /identity/v3/role_assignments?group.id=fc7ad0523b414eb288e4e5f388b2f316&scope.project.id=f82c5c1108704750815ed9407c515587&role.id=609b1a993a394f0e900e17edccebaea5 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:51.008438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b45c-f60d-4404-91fb-019033c87dbd None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:51.009444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b45c-f60d-4404-91fb-019033c87dbd None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:51.009935 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774b45c-f60d-4404-91fb-019033c87dbd None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:51.011501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 217/456] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:51.017338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b101d8-6932-4592-b57c-216cb9a381d2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:51.018173 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b101d8-6932-4592-b57c-216cb9a381d2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:51.018640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b101d8-6932-4592-b57c-216cb9a381d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:51.051628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-39b101d8-6932-4592-b57c-216cb9a381d2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:51.052777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-39b101d8-6932-4592-b57c-216cb9a381d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:51.148717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 240/457] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:51.236168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658b4b3-c5e2-4502-97bf-d41d4f63671b None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:51.236789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658b4b3-c5e2-4502-97bf-d41d4f63671b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:51.237281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658b4b3-c5e2-4502-97bf-d41d4f63671b None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:51.239092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 218/458] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:51.244327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d7ec-77a2-44af-bac7-21c2c698b82f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:51.244619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d7ec-77a2-44af-bac7-21c2c698b82f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:51.244899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d7ec-77a2-44af-bac7-21c2c698b82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:51.269641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a5b0d7ec-77a2-44af-bac7-21c2c698b82f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:51.269641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a5b0d7ec-77a2-44af-bac7-21c2c698b82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:51.355537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:51.361652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 241/459] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:51.418542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893143c-2490-4294-8c40-206867e7c0b1 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:51.418880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893143c-2490-4294-8c40-206867e7c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:51.419174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893143c-2490-4294-8c40-206867e7c0b1 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:51.420763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 219/460] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:51.426553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59d58d-22f5-4b21-90f0-65469b367fd6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:51.426848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59d58d-22f5-4b21-90f0-65469b367fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:51.427152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59d58d-22f5-4b21-90f0-65469b367fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:51.450595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6c59d58d-22f5-4b21-90f0-65469b367fd6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:51.451807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6c59d58d-22f5-4b21-90f0-65469b367fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:51.545512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 242/461] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:51.556287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893143c-2490-4294-8c40-206867e7c0b1 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:51.666650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:51.712173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893143c-2490-4294-8c40-206867e7c0b1 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:51.764302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59d58d-22f5-4b21-90f0-65469b367fd6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:51.768723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b87a-2986-4e20-a874-dad4de691020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:51.772709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b87a-2986-4e20-a874-dad4de691020 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:51.772709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b87a-2986-4e20-a874-dad4de691020 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:51.772709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b87a-2986-4e20-a874-dad4de691020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:51.790214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b87a-2986-4e20-a874-dad4de691020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:51.791944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b87a-2986-4e20-a874-dad4de691020 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-5f55b87a-2986-4e20-a874-dad4de691020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:51.821659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:51.822756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:51.823720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:51.823720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:51.823720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:51.831307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 220/462] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:51.832293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b87a-2986-4e20-a874-dad4de691020 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:51.939959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59d58d-22f5-4b21-90f0-65469b367fd6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:51.950680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b87a-2986-4e20-a874-dad4de691020 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:51.975768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:51.977779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:51.989386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ad386-dfd3-448f-a696-bbcd9daefda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:51.989693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deebf1-be40-4289-8390-1b1f6b9e05c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:51.990394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deebf1-be40-4289-8390-1b1f6b9e05c6 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:51.990668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ad386-dfd3-448f-a696-bbcd9daefda9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:51.990770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deebf1-be40-4289-8390-1b1f6b9e05c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:51.991112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deebf1-be40-4289-8390-1b1f6b9e05c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:51.991463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ad386-dfd3-448f-a696-bbcd9daefda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:51.991890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deebf1-be40-4289-8390-1b1f6b9e05c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:51.992156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ad386-dfd3-448f-a696-bbcd9daefda9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:51.992274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deebf1-be40-4289-8390-1b1f6b9e05c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:51.993844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deebf1-be40-4289-8390-1b1f6b9e05c6 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:52.006527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ad386-dfd3-448f-a696-bbcd9daefda9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:52.007487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 221/463] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:52.008442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deebf1-be40-4289-8390-1b1f6b9e05c6 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:52.008999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ad386-dfd3-448f-a696-bbcd9daefda9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-567ad386-dfd3-448f-a696-bbcd9daefda9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:52.029822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:52.031385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:52.032404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:52.032404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:52.032404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:52.032601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 243/464] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:52.037977 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ad386-dfd3-448f-a696-bbcd9daefda9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:52.145414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deebf1-be40-4289-8390-1b1f6b9e05c6 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:52.150768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ad386-dfd3-448f-a696-bbcd9daefda9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:52.182763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cab16a-3111-4fd3-a747-4a12bbb9ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:52.183702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab16a-3111-4fd3-a747-4a12bbb9ed4f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.184146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab16a-3111-4fd3-a747-4a12bbb9ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.184571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cab16a-3111-4fd3-a747-4a12bbb9ed4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.191862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cc2c8-bf3e-4acd-9684-f7f9e1a21f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:52.192457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc2c8-bf3e-4acd-9684-f7f9e1a21f93 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.192782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc2c8-bf3e-4acd-9684-f7f9e1a21f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.193092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc2c8-bf3e-4acd-9684-f7f9e1a21f93 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.193913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cc2c8-bf3e-4acd-9684-f7f9e1a21f93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:52.195550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cc2c8-bf3e-4acd-9684-f7f9e1a21f93 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:52.198214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cab16a-3111-4fd3-a747-4a12bbb9ed4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:52.199830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cab16a-3111-4fd3-a747-4a12bbb9ed4f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-06cab16a-3111-4fd3-a747-4a12bbb9ed4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:52.216697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:52.217665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:52.218536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:52.218536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:52.218536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:52.223241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 244/465] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:52 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:52.223411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 222/466] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:52.231084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cc2c8-bf3e-4acd-9684-f7f9e1a21f93 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:52.231296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a2144-a270-4b0f-ad62-761912388978 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.231296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a2144-a270-4b0f-ad62-761912388978 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.231296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a2144-a270-4b0f-ad62-761912388978 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.231296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 223/467] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:52.231767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a2144-a270-4b0f-ad62-761912388978 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:52.277821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:52.279831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:52.371695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cc2c8-bf3e-4acd-9684-f7f9e1a21f93 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:52.383921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a2144-a270-4b0f-ad62-761912388978 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:52.416544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60373063-d70a-4251-956a-c59c7fb739e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:52.417274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60373063-d70a-4251-956a-c59c7fb739e7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.417620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60373063-d70a-4251-956a-c59c7fb739e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.418019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60373063-d70a-4251-956a-c59c7fb739e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.418683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60373063-d70a-4251-956a-c59c7fb739e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:52.419026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60373063-d70a-4251-956a-c59c7fb739e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:52.420519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60373063-d70a-4251-956a-c59c7fb739e7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:52.426453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ff12d-8e58-4c25-a59b-70847049963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:52.428330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ff12d-8e58-4c25-a59b-70847049963d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.428330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ff12d-8e58-4c25-a59b-70847049963d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.428330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ff12d-8e58-4c25-a59b-70847049963d None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.428793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ff12d-8e58-4c25-a59b-70847049963d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:52.429109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ff12d-8e58-4c25-a59b-70847049963d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:52.430963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ff12d-8e58-4c25-a59b-70847049963d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:52.433029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 245/468] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:52.434427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246678-ce84-4d63-9aa6-e346e17782f7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.434849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246678-ce84-4d63-9aa6-e346e17782f7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.435287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246678-ce84-4d63-9aa6-e346e17782f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.444436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 224/469] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:52.445199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ff12d-8e58-4c25-a59b-70847049963d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:52.456973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6f246678-ce84-4d63-9aa6-e346e17782f7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:52.458528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6f246678-ce84-4d63-9aa6-e346e17782f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:52.548316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 246/470] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:52.549456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f246678-ce84-4d63-9aa6-e346e17782f7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:52.575283 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:52.580851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:52.584536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ff12d-8e58-4c25-a59b-70847049963d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:52.653184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8b126-d450-4356-af12-7855b31aad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:52.653785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b126-d450-4356-af12-7855b31aad3d None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.654071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b126-d450-4356-af12-7855b31aad3d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.654490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8b126-d450-4356-af12-7855b31aad3d None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.655249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8b126-d450-4356-af12-7855b31aad3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:52.656700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8b126-d450-4356-af12-7855b31aad3d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:52.679104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f246678-ce84-4d63-9aa6-e346e17782f7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:52.684052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 225/471] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:52 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:52.725502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccd34d-fbc1-4015-bcc2-9bf92170e050 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.725684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccd34d-fbc1-4015-bcc2-9bf92170e050 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.725969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccd34d-fbc1-4015-bcc2-9bf92170e050 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.727643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 226/472] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:52.728248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2d3ad-54a0-4537-805d-ccb7bfd821b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:52.729046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2d3ad-54a0-4537-805d-ccb7bfd821b8 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.729326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2d3ad-54a0-4537-805d-ccb7bfd821b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.729645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2d3ad-54a0-4537-805d-ccb7bfd821b8 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.730305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2d3ad-54a0-4537-805d-ccb7bfd821b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:52.733008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa031d-c465-4f65-956a-2d927db09193 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:52.733294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa031d-c465-4f65-956a-2d927db09193 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:52.733621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa031d-c465-4f65-956a-2d927db09193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:52.741805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2d3ad-54a0-4537-805d-ccb7bfd821b8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:52.761934 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f8fa031d-c465-4f65-956a-2d927db09193 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:52.763312 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f8fa031d-c465-4f65-956a-2d927db09193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:52.783247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 247/473] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:52 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:52.885579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 227/474] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:52.947882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2d3ad-54a0-4537-805d-ccb7bfd821b8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.039378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.059712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2d3ad-54a0-4537-805d-ccb7bfd821b8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.094648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b20c4-3a09-462c-ab39-94b4a134f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.095874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b20c4-3a09-462c-ab39-94b4a134f668 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.096156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b20c4-3a09-462c-ab39-94b4a134f668 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.096429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b20c4-3a09-462c-ab39-94b4a134f668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.108349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b20c4-3a09-462c-ab39-94b4a134f668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.109835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b20c4-3a09-462c-ab39-94b4a134f668 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4d6b20c4-3a09-462c-ab39-94b4a134f668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:53.125659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:53.127164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:53.128002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:53.128002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:53.128002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:53.128002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 248/475] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:53.133223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa031d-c465-4f65-956a-2d927db09193 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.187374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b20c4-3a09-462c-ab39-94b4a134f668 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.239400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.268936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa031d-c465-4f65-956a-2d927db09193 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.301472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b20c4-3a09-462c-ab39-94b4a134f668 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.342602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd208-8cf3-438c-8011-29c0c38f649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.343247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd208-8cf3-438c-8011-29c0c38f649e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.343526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd208-8cf3-438c-8011-29c0c38f649e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.343801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dd208-8cf3-438c-8011-29c0c38f649e None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.344462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dd208-8cf3-438c-8011-29c0c38f649e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:53.344792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dd208-8cf3-438c-8011-29c0c38f649e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.346166 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dd208-8cf3-438c-8011-29c0c38f649e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.360622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.361239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.361519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.361790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.362479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.363875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.368425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.371768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 228/476] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:53.378423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.sql.core [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 15:26:53.378423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 15:26:53.378423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [parameters: {'id': '1c1f94c663e446bcbd48dd998b11ec4e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 15:26:53.378423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81766) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 15:26:53.394013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd208-8cf3-438c-8011-29c0c38f649e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Aug 26 15:26:53.409384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return ref.to_dict() Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:26:53.410599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application yield resource Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise self.value Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application session.commit() Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 15:26:53.411756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.flush() Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application compat.raise_( Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 15:26:53.412802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:26:53.413938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:26:53.414924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [parameters: {'id': '1c1f94c663e446bcbd48dd998b11ec4e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:53.415944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 15:26:53.416904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:53.418026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 249/477] 10.222.0.89 () {60 vars in 1131 bytes} [Fri Aug 26 15:26:53 2022] POST /identity/v3/roles => generated 144 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:53.421807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.533416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ebd85-d6e4-431a-b65f-01b0f3268b32 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.565245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dd208-8cf3-438c-8011-29c0c38f649e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.580337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2875d-2f9a-4bb9-a8e3-e25226d46fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.581131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2875d-2f9a-4bb9-a8e3-e25226d46fdb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.581512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2875d-2f9a-4bb9-a8e3-e25226d46fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.581887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2875d-2f9a-4bb9-a8e3-e25226d46fdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.592669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2875d-2f9a-4bb9-a8e3-e25226d46fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-5dd2875d-2f9a-4bb9-a8e3-e25226d46fdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:53.598405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:53.599585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 15:26:53.600550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:53.602911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 250/478] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:26:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:53.608001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2875d-2f9a-4bb9-a8e3-e25226d46fdb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:53.625368 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b28998-821a-43b4-8152-bec39aba52af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.626522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28998-821a-43b4-8152-bec39aba52af None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.626797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28998-821a-43b4-8152-bec39aba52af None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.627100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b28998-821a-43b4-8152-bec39aba52af None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.627752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28998-821a-43b4-8152-bec39aba52af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.629428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b28998-821a-43b4-8152-bec39aba52af None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.656767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.671576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 229/479] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:53 2022] POST /identity/v3/users => generated 249 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:26:53.684678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:53.745713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2875d-2f9a-4bb9-a8e3-e25226d46fdb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:53.793114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d351759-4d5a-4679-89dd-15aa130b4f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:53.793921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d351759-4d5a-4679-89dd-15aa130b4f17 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:53.794299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d351759-4d5a-4679-89dd-15aa130b4f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:53.794678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d351759-4d5a-4679-89dd-15aa130b4f17 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:53.797661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d351759-4d5a-4679-89dd-15aa130b4f17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:53.797661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d351759-4d5a-4679-89dd-15aa130b4f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:53.797661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d351759-4d5a-4679-89dd-15aa130b4f17 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:53.811068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 251/480] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:54.609693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b10ddd-b209-4e0d-8f66-625d5e7aaab3 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.610237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b10ddd-b209-4e0d-8f66-625d5e7aaab3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.610577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b10ddd-b209-4e0d-8f66-625d5e7aaab3 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.612351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 230/481] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:54.617685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea542835-ebda-431e-be38-712610cbae05 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:54.618086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea542835-ebda-431e-be38-712610cbae05 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:54.618485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea542835-ebda-431e-be38-712610cbae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:54.643870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ea542835-ebda-431e-be38-712610cbae05 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:54.645055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ea542835-ebda-431e-be38-712610cbae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:54.723049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 252/482] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:55.143126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b10ddd-b209-4e0d-8f66-625d5e7aaab3 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:55.175272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50f87-db61-400d-9b44-46563a90e963 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.175628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50f87-db61-400d-9b44-46563a90e963 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.175824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50f87-db61-400d-9b44-46563a90e963 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.177409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 253/483] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:55.182209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f771a-5802-43b9-90ef-061ba431f0c8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.182489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f771a-5802-43b9-90ef-061ba431f0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.182772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f771a-5802-43b9-90ef-061ba431f0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.200504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-568f771a-5802-43b9-90ef-061ba431f0c8 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:55.201691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-568f771a-5802-43b9-90ef-061ba431f0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:55.257283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:55.260291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b10ddd-b209-4e0d-8f66-625d5e7aaab3 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:55.280436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 254/484] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:26:55.297542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8af0-22cb-4325-8a3d-0837c3402be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:55.298544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8af0-22cb-4325-8a3d-0837c3402be9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.299066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8af0-22cb-4325-8a3d-0837c3402be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.299546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8af0-22cb-4325-8a3d-0837c3402be9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.310271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d8af0-22cb-4325-8a3d-0837c3402be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-d64d8af0-22cb-4325-8a3d-0837c3402be9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:55.315528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:55.316405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:55.317209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:55.320753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 231/485] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:26:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:55.326643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f771a-5802-43b9-90ef-061ba431f0c8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:55.440146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f771a-5802-43b9-90ef-061ba431f0c8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:55.488696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326825f-d885-46d5-a2a9-06e33aa20057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:55.489680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326825f-d885-46d5-a2a9-06e33aa20057 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.490166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326825f-d885-46d5-a2a9-06e33aa20057 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.490649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326825f-d885-46d5-a2a9-06e33aa20057 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.491568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326825f-d885-46d5-a2a9-06e33aa20057 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:55.492076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326825f-d885-46d5-a2a9-06e33aa20057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:55.493651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326825f-d885-46d5-a2a9-06e33aa20057 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:55.503492 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 255/486] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:26:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:55.509245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8af0-22cb-4325-8a3d-0837c3402be9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:55.540848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bcc0f-465e-48e6-9947-8a8d9b9a37fa None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.541454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bcc0f-465e-48e6-9947-8a8d9b9a37fa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.541934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bcc0f-465e-48e6-9947-8a8d9b9a37fa None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.543488 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 256/487] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:26:55.548682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a9bf0-a6ac-4bf8-8b73-36e51fc0a738 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.549213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a9bf0-a6ac-4bf8-8b73-36e51fc0a738 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.549714 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a9bf0-a6ac-4bf8-8b73-36e51fc0a738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.583045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ea1a9bf0-a6ac-4bf8-8b73-36e51fc0a738 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:55.585243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ea1a9bf0-a6ac-4bf8-8b73-36e51fc0a738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:55.615293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:55.651477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:55.660866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8af0-22cb-4325-8a3d-0837c3402be9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:55.678160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 257/488] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:55.679033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a9bf0-a6ac-4bf8-8b73-36e51fc0a738 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:55.697010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873844-e2d2-43e2-be8d-35f69f02c831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:55.697616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873844-e2d2-43e2-be8d-35f69f02c831 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.697903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873844-e2d2-43e2-be8d-35f69f02c831 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.698177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873844-e2d2-43e2-be8d-35f69f02c831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.709803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73873844-e2d2-43e2-be8d-35f69f02c831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:55.711308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73873844-e2d2-43e2-be8d-35f69f02c831 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-73873844-e2d2-43e2-be8d-35f69f02c831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:55.726379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:55.727349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:55.729240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:55.729240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:55.729240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:55.729240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 232/489] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:55.734313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873844-e2d2-43e2-be8d-35f69f02c831 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:55.827124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a9bf0-a6ac-4bf8-8b73-36e51fc0a738 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:55.895890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd77891-0b4e-4a68-812b-e0945d680308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:55.897772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77891-0b4e-4a68-812b-e0945d680308 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.898971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77891-0b4e-4a68-812b-e0945d680308 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.899424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77891-0b4e-4a68-812b-e0945d680308 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.912426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873844-e2d2-43e2-be8d-35f69f02c831 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:55.924983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd77891-0b4e-4a68-812b-e0945d680308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-5fd77891-0b4e-4a68-812b-e0945d680308 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:55.929974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:55.930835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:55.931661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:55.937000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 258/490] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:26:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:55.943781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd77891-0b4e-4a68-812b-e0945d680308 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:55.944246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:55.984965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4836e1-4995-47ec-bb64-f731db9aef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:55.986019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4836e1-4995-47ec-bb64-f731db9aef66 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:55.987362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4836e1-4995-47ec-bb64-f731db9aef66 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:55.987642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4836e1-4995-47ec-bb64-f731db9aef66 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:55.988302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4836e1-4995-47ec-bb64-f731db9aef66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:55.988614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4836e1-4995-47ec-bb64-f731db9aef66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:55.989973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4836e1-4995-47ec-bb64-f731db9aef66 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:56.006606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:56.017534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 233/491] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:26:56.018681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4836e1-4995-47ec-bb64-f731db9aef66 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.087136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd77891-0b4e-4a68-812b-e0945d680308 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.129453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bdc5f-e45d-4035-9053-b7585f9edfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:56.130124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bdc5f-e45d-4035-9053-b7585f9edfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.130403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bdc5f-e45d-4035-9053-b7585f9edfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.130679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bdc5f-e45d-4035-9053-b7585f9edfb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.131437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bdc5f-e45d-4035-9053-b7585f9edfb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:56.131744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bdc5f-e45d-4035-9053-b7585f9edfb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:56.133119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bdc5f-e45d-4035-9053-b7585f9edfb8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:56.142265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 259/492] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:26:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:56.143123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bdc5f-e45d-4035-9053-b7585f9edfb8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.155404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4836e1-4995-47ec-bb64-f731db9aef66 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.199356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f35f2-7b8c-4615-a3ad-dbd709810c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:56.200422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f35f2-7b8c-4615-a3ad-dbd709810c0d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.200715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f35f2-7b8c-4615-a3ad-dbd709810c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.200992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f35f2-7b8c-4615-a3ad-dbd709810c0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.211732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f35f2-7b8c-4615-a3ad-dbd709810c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-b27f35f2-7b8c-4615-a3ad-dbd709810c0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:56.216502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:56.217371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:56.218141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 234/493] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:56.218772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f35f2-7b8c-4615-a3ad-dbd709810c0d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.247420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:56.251984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:56.254321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bdc5f-e45d-4035-9053-b7585f9edfb8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.288825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ceb6f1-7195-44e0-9ab3-faaf30dfd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:56.289455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceb6f1-7195-44e0-9ab3-faaf30dfd403 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.289739 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceb6f1-7195-44e0-9ab3-faaf30dfd403 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.290015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceb6f1-7195-44e0-9ab3-faaf30dfd403 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.297310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ceb6f1-7195-44e0-9ab3-faaf30dfd403 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:56.299390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ceb6f1-7195-44e0-9ab3-faaf30dfd403 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-66ceb6f1-7195-44e0-9ab3-faaf30dfd403 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:26:56.311552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:56.312604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 260/494] 10.222.0.89 () {56 vars in 1093 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955898c2-3548-4964-a138-2e3f662fecf2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.322677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955898c2-3548-4964-a138-2e3f662fecf2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.323455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955898c2-3548-4964-a138-2e3f662fecf2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.323455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 261/495] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:56.323455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c509ec-4052-4987-ab4d-8d6147474f79 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.323455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c509ec-4052-4987-ab4d-8d6147474f79 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.323455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c509ec-4052-4987-ab4d-8d6147474f79 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.323455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 262/496] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:26:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:26:56.323455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c509ec-4052-4987-ab4d-8d6147474f79 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.324152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f35f2-7b8c-4615-a3ad-dbd709810c0d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.357540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63918ef5-cb42-4e45-beaf-abd81f96a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:56.358152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63918ef5-cb42-4e45-beaf-abd81f96a51c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.358430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63918ef5-cb42-4e45-beaf-abd81f96a51c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.358701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63918ef5-cb42-4e45-beaf-abd81f96a51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.369060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63918ef5-cb42-4e45-beaf-abd81f96a51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:56.370485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63918ef5-cb42-4e45-beaf-abd81f96a51c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-63918ef5-cb42-4e45-beaf-abd81f96a51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:56.384513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:56.385574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:56.391703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:56.391703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:56.391703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:56.391703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 235/497] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:56.391703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63918ef5-cb42-4e45-beaf-abd81f96a51c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.427271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c509ec-4052-4987-ab4d-8d6147474f79 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.459429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170030f3-8e69-4aee-8305-857726976062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:56.460025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170030f3-8e69-4aee-8305-857726976062 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.460307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170030f3-8e69-4aee-8305-857726976062 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.460572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170030f3-8e69-4aee-8305-857726976062 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.461227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170030f3-8e69-4aee-8305-857726976062 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:56.461521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170030f3-8e69-4aee-8305-857726976062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:56.462892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170030f3-8e69-4aee-8305-857726976062 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:56.465192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:56.471356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 263/498] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:56.472510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026280f2-9b4f-4ac2-bc4d-7ebb6d3423d2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.472789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026280f2-9b4f-4ac2-bc4d-7ebb6d3423d2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.473062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026280f2-9b4f-4ac2-bc4d-7ebb6d3423d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.484449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63918ef5-cb42-4e45-beaf-abd81f96a51c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.491723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-026280f2-9b4f-4ac2-bc4d-7ebb6d3423d2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:56.492927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-026280f2-9b4f-4ac2-bc4d-7ebb6d3423d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:56.504089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:56.518113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c10cb-a86a-4307-93b9-dfec0e8bf7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:56.518718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c10cb-a86a-4307-93b9-dfec0e8bf7ae None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.519030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c10cb-a86a-4307-93b9-dfec0e8bf7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.519308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c10cb-a86a-4307-93b9-dfec0e8bf7ae None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.520038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c10cb-a86a-4307-93b9-dfec0e8bf7ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:56.520361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c10cb-a86a-4307-93b9-dfec0e8bf7ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:56.521787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c10cb-a86a-4307-93b9-dfec0e8bf7ae None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:56.557306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 236/499] 10.222.0.89 () {56 vars in 1133 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:56.558615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f98dc-31cf-4a19-8e90-ab1b2a43bc65 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.558908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f98dc-31cf-4a19-8e90-ab1b2a43bc65 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.559218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f98dc-31cf-4a19-8e90-ab1b2a43bc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.571001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 264/500] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:56.571001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026280f2-9b4f-4ac2-bc4d-7ebb6d3423d2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.589020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-119f98dc-31cf-4a19-8e90-ab1b2a43bc65 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:26:56.590336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-119f98dc-31cf-4a19-8e90-ab1b2a43bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:26:56.660126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026280f2-9b4f-4ac2-bc4d-7ebb6d3423d2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.671223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 237/501] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:26:56.671223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f98dc-31cf-4a19-8e90-ab1b2a43bc65 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.710640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91579645-7f89-4119-bd43-e1076888b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:56.712112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91579645-7f89-4119-bd43-e1076888b392 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.712398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91579645-7f89-4119-bd43-e1076888b392 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.712672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91579645-7f89-4119-bd43-e1076888b392 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.713322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91579645-7f89-4119-bd43-e1076888b392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:56.713626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91579645-7f89-4119-bd43-e1076888b392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:56.715019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91579645-7f89-4119-bd43-e1076888b392 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:56.731119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 265/502] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:56.731953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91579645-7f89-4119-bd43-e1076888b392 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.743561 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:56.752272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:56.786075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f98dc-31cf-4a19-8e90-ab1b2a43bc65 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.833114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54b7c4-de94-48ca-9e0c-6f4d7b41fba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:56.834024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54b7c4-de94-48ca-9e0c-6f4d7b41fba4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.834311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54b7c4-de94-48ca-9e0c-6f4d7b41fba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.834586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54b7c4-de94-48ca-9e0c-6f4d7b41fba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.846921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54b7c4-de94-48ca-9e0c-6f4d7b41fba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:56.848414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54b7c4-de94-48ca-9e0c-6f4d7b41fba4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:56.855630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91579645-7f89-4119-bd43-e1076888b392 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-fa54b7c4-de94-48ca-9e0c-6f4d7b41fba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:56.863668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:56.864556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:56.865375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:56.865375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:56.865375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:56.865375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 238/503] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:56.865590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54b7c4-de94-48ca-9e0c-6f4d7b41fba4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:56.902915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e41e2-1fa7-4c95-9f99-1a05e516e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:56.903545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e41e2-1fa7-4c95-9f99-1a05e516e242 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:56.903823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e41e2-1fa7-4c95-9f99-1a05e516e242 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:56.904092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e41e2-1fa7-4c95-9f99-1a05e516e242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:56.967829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54b7c4-de94-48ca-9e0c-6f4d7b41fba4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:56.973185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e41e2-1fa7-4c95-9f99-1a05e516e242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:56.974621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e41e2-1fa7-4c95-9f99-1a05e516e242 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:56.981956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:56.991054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.002713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a123ab-f447-4b23-80b1-8f64a0359bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.003362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a123ab-f447-4b23-80b1-8f64a0359bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.003642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a123ab-f447-4b23-80b1-8f64a0359bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.003909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a123ab-f447-4b23-80b1-8f64a0359bd0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.011110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a123ab-f447-4b23-80b1-8f64a0359bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.012540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a123ab-f447-4b23-80b1-8f64a0359bd0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-03a123ab-f447-4b23-80b1-8f64a0359bd0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:26:57.025071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.026089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 239/504] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.026981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a123ab-f447-4b23-80b1-8f64a0359bd0 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.075137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 266/505] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:57.076140 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e41e2-1fa7-4c95-9f99-1a05e516e242 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.133497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a123ab-f447-4b23-80b1-8f64a0359bd0 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.170787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b743d-08a0-4ddd-b004-ab53827946cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.171433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b743d-08a0-4ddd-b004-ab53827946cd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.171735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b743d-08a0-4ddd-b004-ab53827946cd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.172092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b743d-08a0-4ddd-b004-ab53827946cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.176468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e41e2-1fa7-4c95-9f99-1a05e516e242 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.183432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b743d-08a0-4ddd-b004-ab53827946cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.184476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.184906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b743d-08a0-4ddd-b004-ab53827946cd None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-527b743d-08a0-4ddd-b004-ab53827946cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:57.199262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.200184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:57.201023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:57.201023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:57.201023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:57.201023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 240/506] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.201228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b743d-08a0-4ddd-b004-ab53827946cd None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.216372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b708952-68f0-45b8-bda5-6f270973e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.216973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b708952-68f0-45b8-bda5-6f270973e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.217250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b708952-68f0-45b8-bda5-6f270973e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.217523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b708952-68f0-45b8-bda5-6f270973e4b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.218162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b708952-68f0-45b8-bda5-6f270973e4b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:57.218465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b708952-68f0-45b8-bda5-6f270973e4b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.220461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b708952-68f0-45b8-bda5-6f270973e4b9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.231682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 267/507] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:57.232637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b708952-68f0-45b8-bda5-6f270973e4b9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.239864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.305538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b743d-08a0-4ddd-b004-ab53827946cd None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.333543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b708952-68f0-45b8-bda5-6f270973e4b9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.339048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abb62b-64eb-4375-b2d8-097ca42c3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.339672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb62b-64eb-4375-b2d8-097ca42c3104 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.339956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb62b-64eb-4375-b2d8-097ca42c3104 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.340235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb62b-64eb-4375-b2d8-097ca42c3104 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.350002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abb62b-64eb-4375-b2d8-097ca42c3104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-05abb62b-64eb-4375-b2d8-097ca42c3104 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:26:57.354690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.355764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 241/508] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.356755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abb62b-64eb-4375-b2d8-097ca42c3104 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.366867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabc601-c85c-42f0-b080-8b8cd5218072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.367503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabc601-c85c-42f0-b080-8b8cd5218072 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.367783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabc601-c85c-42f0-b080-8b8cd5218072 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.368058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabc601-c85c-42f0-b080-8b8cd5218072 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.368791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabc601-c85c-42f0-b080-8b8cd5218072 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:57.369099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabc601-c85c-42f0-b080-8b8cd5218072 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.370530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabc601-c85c-42f0-b080-8b8cd5218072 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.406325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 268/509] 10.222.0.89 () {56 vars in 1137 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:57.407207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabc601-c85c-42f0-b080-8b8cd5218072 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.432105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.455120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.462437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abb62b-64eb-4375-b2d8-097ca42c3104 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.495972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0a147-3fac-4b96-bbd9-5684bcacf6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.496592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0a147-3fac-4b96-bbd9-5684bcacf6ab None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.496871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0a147-3fac-4b96-bbd9-5684bcacf6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.497146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0a147-3fac-4b96-bbd9-5684bcacf6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.507227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabc601-c85c-42f0-b080-8b8cd5218072 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.507545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0a147-3fac-4b96-bbd9-5684bcacf6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.509020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0a147-3fac-4b96-bbd9-5684bcacf6ab None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-a2d0a147-3fac-4b96-bbd9-5684bcacf6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:57.524021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.525078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:57.525936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:57.525936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:57.525936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:57.525936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 242/510] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.526146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0a147-3fac-4b96-bbd9-5684bcacf6ab None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.544164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bec72-7332-4759-af76-84cec7612a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.544769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bec72-7332-4759-af76-84cec7612a45 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.545048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bec72-7332-4759-af76-84cec7612a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.545325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bec72-7332-4759-af76-84cec7612a45 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.545966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bec72-7332-4759-af76-84cec7612a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:57.546271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bec72-7332-4759-af76-84cec7612a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.548517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bec72-7332-4759-af76-84cec7612a45 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.559752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 269/511] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:57.560542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bec72-7332-4759-af76-84cec7612a45 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.630592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0a147-3fac-4b96-bbd9-5684bcacf6ab None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.643636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.659729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bec72-7332-4759-af76-84cec7612a45 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.664542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1f2bd-3c1d-469f-97a3-c8570d3082f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.665172 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1f2bd-3c1d-469f-97a3-c8570d3082f9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.665454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1f2bd-3c1d-469f-97a3-c8570d3082f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.665726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1f2bd-3c1d-469f-97a3-c8570d3082f9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.673667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1f2bd-3c1d-469f-97a3-c8570d3082f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.675507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1f2bd-3c1d-469f-97a3-c8570d3082f9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-38f1f2bd-3c1d-469f-97a3-c8570d3082f9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:26:57.686323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:57.687302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 243/512] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:57.688168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1f2bd-3c1d-469f-97a3-c8570d3082f9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.696746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.697809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d382dbb-5226-41c1-b454-7d6eefc5e480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.698646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d382dbb-5226-41c1-b454-7d6eefc5e480 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.699112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d382dbb-5226-41c1-b454-7d6eefc5e480 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.699393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d382dbb-5226-41c1-b454-7d6eefc5e480 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.700069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d382dbb-5226-41c1-b454-7d6eefc5e480 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:57.700373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d382dbb-5226-41c1-b454-7d6eefc5e480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.701807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d382dbb-5226-41c1-b454-7d6eefc5e480 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.710269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 270/513] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:57.710906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d382dbb-5226-41c1-b454-7d6eefc5e480 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.788646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1f2bd-3c1d-469f-97a3-c8570d3082f9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.818392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d382dbb-5226-41c1-b454-7d6eefc5e480 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.823347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294406aa-7142-44df-896d-51cb6b9d120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.824009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294406aa-7142-44df-896d-51cb6b9d120b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.824294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294406aa-7142-44df-896d-51cb6b9d120b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.824572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294406aa-7142-44df-896d-51cb6b9d120b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.852506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341c7d6-6f00-46af-9426-6886359f4033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:57.853109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341c7d6-6f00-46af-9426-6886359f4033 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:57.853387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341c7d6-6f00-46af-9426-6886359f4033 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:57.853665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341c7d6-6f00-46af-9426-6886359f4033 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:57.854302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341c7d6-6f00-46af-9426-6886359f4033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:57.854608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341c7d6-6f00-46af-9426-6886359f4033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.856035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341c7d6-6f00-46af-9426-6886359f4033 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.868209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 271/514] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:57.873510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341c7d6-6f00-46af-9426-6886359f4033 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:57.881666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.892588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294406aa-7142-44df-896d-51cb6b9d120b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:57.894061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294406aa-7142-44df-896d-51cb6b9d120b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:57.902267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:57.973788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341c7d6-6f00-46af-9426-6886359f4033 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:57.992720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 244/515] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:57.993547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294406aa-7142-44df-896d-51cb6b9d120b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.009010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8dec8-937e-46da-a8d2-cd1bd3b2e0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.009641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8dec8-937e-46da-a8d2-cd1bd3b2e0f1 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.009921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8dec8-937e-46da-a8d2-cd1bd3b2e0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.010196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8dec8-937e-46da-a8d2-cd1bd3b2e0f1 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.010834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8dec8-937e-46da-a8d2-cd1bd3b2e0f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.012285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8dec8-937e-46da-a8d2-cd1bd3b2e0f1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.034153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 272/516] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:26:57 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:26:58.035030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8dec8-937e-46da-a8d2-cd1bd3b2e0f1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.098323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294406aa-7142-44df-896d-51cb6b9d120b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.106890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.119327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.138680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5939-dbf0-4507-a146-a54e840fa555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.139252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5939-dbf0-4507-a146-a54e840fa555 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.139533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5939-dbf0-4507-a146-a54e840fa555 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.139807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c5939-dbf0-4507-a146-a54e840fa555 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.140557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5939-dbf0-4507-a146-a54e840fa555 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:58.141129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5939-dbf0-4507-a146-a54e840fa555 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.149499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c5939-dbf0-4507-a146-a54e840fa555 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.169131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8dec8-937e-46da-a8d2-cd1bd3b2e0f1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.169363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 245/517] 10.222.0.89 () {56 vars in 1137 bytes} [Fri Aug 26 15:26:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:58.170101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5939-dbf0-4507-a146-a54e840fa555 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.215489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1f08-71bd-4ece-b5f0-6923daed89e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.216313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1f08-71bd-4ece-b5f0-6923daed89e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.216659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1f08-71bd-4ece-b5f0-6923daed89e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.217003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1f08-71bd-4ece-b5f0-6923daed89e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.228856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c1f08-71bd-4ece-b5f0-6923daed89e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.230329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c1f08-71bd-4ece-b5f0-6923daed89e6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b64c1f08-71bd-4ece-b5f0-6923daed89e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:58.245802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:58.246738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:58.248190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:58.248190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:58.248190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:58.248190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 273/518] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:58.248190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1f08-71bd-4ece-b5f0-6923daed89e6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.286702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c5939-dbf0-4507-a146-a54e840fa555 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.324483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e54c-30f6-45a2-bb87-b2263d31567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.325123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e54c-30f6-45a2-bb87-b2263d31567e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.325407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e54c-30f6-45a2-bb87-b2263d31567e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.325680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e54c-30f6-45a2-bb87-b2263d31567e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.333122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1e54c-30f6-45a2-bb87-b2263d31567e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.334562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1e54c-30f6-45a2-bb87-b2263d31567e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-51d1e54c-30f6-45a2-bb87-b2263d31567e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:26:58.347057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:58.348093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:58.349209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:26:58.349209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:26:58.349209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:26:58.349209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:26:58.349209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:26:58.349209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:26:58.349209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:26:58.349209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:58.352739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 246/519] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:58.353586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e54c-30f6-45a2-bb87-b2263d31567e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.372975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1f08-71bd-4ece-b5f0-6923daed89e6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.383809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.389885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.411740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bff24-92f3-47e2-bca8-d0acd80096cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.412376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bff24-92f3-47e2-bca8-d0acd80096cd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.412671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bff24-92f3-47e2-bca8-d0acd80096cd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.412983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bff24-92f3-47e2-bca8-d0acd80096cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.424029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bff24-92f3-47e2-bca8-d0acd80096cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.425789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bff24-92f3-47e2-bca8-d0acd80096cd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-539bff24-92f3-47e2-bca8-d0acd80096cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:58.441123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:58.442042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:58.443554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:58.443554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:58.443554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:58.443554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 274/520] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:58.443554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bff24-92f3-47e2-bca8-d0acd80096cd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.478346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e54c-30f6-45a2-bb87-b2263d31567e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.514754 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab5966-9571-4d70-9c0b-1cab2a52b775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.515416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5966-9571-4d70-9c0b-1cab2a52b775 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.515963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5966-9571-4d70-9c0b-1cab2a52b775 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.516242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5966-9571-4d70-9c0b-1cab2a52b775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.556100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bff24-92f3-47e2-bca8-d0acd80096cd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.586273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab5966-9571-4d70-9c0b-1cab2a52b775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.587759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab5966-9571-4d70-9c0b-1cab2a52b775 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.590974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d278e1-96a0-422f-89af-a59bbc569406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.591183 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d278e1-96a0-422f-89af-a59bbc569406 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.591458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d278e1-96a0-422f-89af-a59bbc569406 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.591731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d278e1-96a0-422f-89af-a59bbc569406 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.592371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d278e1-96a0-422f-89af-a59bbc569406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:58.592668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d278e1-96a0-422f-89af-a59bbc569406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.594018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d278e1-96a0-422f-89af-a59bbc569406 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.607391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 275/521] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:58.612394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d278e1-96a0-422f-89af-a59bbc569406 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.615201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.642787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.706031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 247/522] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:58.707529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab5966-9571-4d70-9c0b-1cab2a52b775 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.723824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d278e1-96a0-422f-89af-a59bbc569406 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.758356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71119e-fd6d-41de-8892-05c5387e274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.758990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71119e-fd6d-41de-8892-05c5387e274c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.759284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71119e-fd6d-41de-8892-05c5387e274c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.759523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71119e-fd6d-41de-8892-05c5387e274c None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.760205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71119e-fd6d-41de-8892-05c5387e274c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:58.760502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71119e-fd6d-41de-8892-05c5387e274c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.761924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71119e-fd6d-41de-8892-05c5387e274c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.786825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 276/523] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:58.786825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71119e-fd6d-41de-8892-05c5387e274c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.824074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab5966-9571-4d70-9c0b-1cab2a52b775 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.849777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.862507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29caf-0870-418b-b211-d0a2a2ed35e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.863162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29caf-0870-418b-b211-d0a2a2ed35e4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.863450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29caf-0870-418b-b211-d0a2a2ed35e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.863725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af29caf-0870-418b-b211-d0a2a2ed35e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.864371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29caf-0870-418b-b211-d0a2a2ed35e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:58.864677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29caf-0870-418b-b211-d0a2a2ed35e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.866047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af29caf-0870-418b-b211-d0a2a2ed35e4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.883301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 248/524] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:58.883301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29caf-0870-418b-b211-d0a2a2ed35e4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.884666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:58.894695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71119e-fd6d-41de-8892-05c5387e274c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:58.929646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686efed-d7b3-4510-905d-4d5521884bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:58.930281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686efed-d7b3-4510-905d-4d5521884bbc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:58.930573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686efed-d7b3-4510-905d-4d5521884bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:58.930840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686efed-d7b3-4510-905d-4d5521884bbc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:58.939085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686efed-d7b3-4510-905d-4d5521884bbc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:58.940539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686efed-d7b3-4510-905d-4d5521884bbc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f686efed-d7b3-4510-905d-4d5521884bbc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:26:58.951890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:58.952943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:58.954041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 277/525] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:58.954612 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686efed-d7b3-4510-905d-4d5521884bbc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:58.999873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af29caf-0870-418b-b211-d0a2a2ed35e4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.035935 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb14d25-8b07-4d8d-9307-ff8eee330c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.036563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb14d25-8b07-4d8d-9307-ff8eee330c5c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.037267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb14d25-8b07-4d8d-9307-ff8eee330c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.037545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb14d25-8b07-4d8d-9307-ff8eee330c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.049396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb14d25-8b07-4d8d-9307-ff8eee330c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.050829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb14d25-8b07-4d8d-9307-ff8eee330c5c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-dfb14d25-8b07-4d8d-9307-ff8eee330c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:26:59.066882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:59.067921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:26:59.073177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:26:59.073177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:26:59.073177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:59.073346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686efed-d7b3-4510-905d-4d5521884bbc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.073426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 249/526] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:59.073426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb14d25-8b07-4d8d-9307-ff8eee330c5c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.109310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd16fc-425a-4903-98fd-5f7c51e16fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.110892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd16fc-425a-4903-98fd-5f7c51e16fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.111203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd16fc-425a-4903-98fd-5f7c51e16fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.111549 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd16fc-425a-4903-98fd-5f7c51e16fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.112291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd16fc-425a-4903-98fd-5f7c51e16fc2 None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=5cbda75c38b04e6c89f17e655eb4f737) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.112596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd16fc-425a-4903-98fd-5f7c51e16fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.114003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.114110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd16fc-425a-4903-98fd-5f7c51e16fc2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.121810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 278/527] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:58 2022] GET /identity/v3/role_assignments?user.id=5cbda75c38b04e6c89f17e655eb4f737&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:59.123350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd16fc-425a-4903-98fd-5f7c51e16fc2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.174717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.203967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb14d25-8b07-4d8d-9307-ff8eee330c5c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.242871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a0f56-32dd-4cf1-a487-d0316bc858dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.243838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a0f56-32dd-4cf1-a487-d0316bc858dd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.244325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a0f56-32dd-4cf1-a487-d0316bc858dd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.244763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a0f56-32dd-4cf1-a487-d0316bc858dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.254617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a0f56-32dd-4cf1-a487-d0316bc858dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.256421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a0f56-32dd-4cf1-a487-d0316bc858dd None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-602a0f56-32dd-4cf1-a487-d0316bc858dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:26:59.274309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:59.275345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:59.276169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:26:59.276169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:26:59.276169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:26:59.276169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:26:59.276169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:26:59.276169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:26:59.276169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:26:59.276169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:26:59.280257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 250/528] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:59.281367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a0f56-32dd-4cf1-a487-d0316bc858dd None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.295443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd16fc-425a-4903-98fd-5f7c51e16fc2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.341613 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8422f-7133-4114-9885-108243969bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.342227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8422f-7133-4114-9885-108243969bdf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.342534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8422f-7133-4114-9885-108243969bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.343066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8422f-7133-4114-9885-108243969bdf None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.344231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8422f-7133-4114-9885-108243969bdf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.345078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8422f-7133-4114-9885-108243969bdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.347094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8422f-7133-4114-9885-108243969bdf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.372656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 279/529] 10.222.0.89 () {56 vars in 1139 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:59.374030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8422f-7133-4114-9885-108243969bdf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.396447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.405704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a0f56-32dd-4cf1-a487-d0316bc858dd None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.451399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c643f-8123-4080-944a-ad42243708e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.452624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c643f-8123-4080-944a-ad42243708e9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.453115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c643f-8123-4080-944a-ad42243708e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.453995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c643f-8123-4080-944a-ad42243708e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.454848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c643f-8123-4080-944a-ad42243708e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.455759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c643f-8123-4080-944a-ad42243708e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.457693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c643f-8123-4080-944a-ad42243708e9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.479655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 251/530] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:59.480140 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c643f-8123-4080-944a-ad42243708e9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.480605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.525460 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8422f-7133-4114-9885-108243969bdf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.563357 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7530fca-a703-40e8-a8cf-1ddf7718de1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.564347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7530fca-a703-40e8-a8cf-1ddf7718de1c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.564963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7530fca-a703-40e8-a8cf-1ddf7718de1c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.565448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7530fca-a703-40e8-a8cf-1ddf7718de1c None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.566433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7530fca-a703-40e8-a8cf-1ddf7718de1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.566958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7530fca-a703-40e8-a8cf-1ddf7718de1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.568626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7530fca-a703-40e8-a8cf-1ddf7718de1c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.583892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 280/531] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:59.585087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7530fca-a703-40e8-a8cf-1ddf7718de1c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.588963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c643f-8123-4080-944a-ad42243708e9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.629656 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9e217-c20c-4ff9-82cf-4a92b34b1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.630275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9e217-c20c-4ff9-82cf-4a92b34b1d69 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.630558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9e217-c20c-4ff9-82cf-4a92b34b1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.630829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9e217-c20c-4ff9-82cf-4a92b34b1d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.658993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.694479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7530fca-a703-40e8-a8cf-1ddf7718de1c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.705333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9e217-c20c-4ff9-82cf-4a92b34b1d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.706734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9e217-c20c-4ff9-82cf-4a92b34b1d69 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.724029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.733588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415b48c-91d7-4b5a-b3f0-ceefd78c2d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.734479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415b48c-91d7-4b5a-b3f0-ceefd78c2d34 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.735043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415b48c-91d7-4b5a-b3f0-ceefd78c2d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.735511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415b48c-91d7-4b5a-b3f0-ceefd78c2d34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.742922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415b48c-91d7-4b5a-b3f0-ceefd78c2d34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.744750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415b48c-91d7-4b5a-b3f0-ceefd78c2d34 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a415b48c-91d7-4b5a-b3f0-ceefd78c2d34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:26:59.758084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:26:59.759253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:26:59.760110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:26:59.760110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:26:59.760110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:26:59.760110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:26:59.760110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:26:59.760110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:26:59.760110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:26:59.760110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:26:59.767288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 281/532] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:26:59.768346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415b48c-91d7-4b5a-b3f0-ceefd78c2d34 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.813850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 252/533] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:26:59.814722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9e217-c20c-4ff9-82cf-4a92b34b1d69 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.873739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.881968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415b48c-91d7-4b5a-b3f0-ceefd78c2d34 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.917327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda174e-027a-48d1-900a-4dc6ddcafb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.918268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda174e-027a-48d1-900a-4dc6ddcafb1b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.918741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda174e-027a-48d1-900a-4dc6ddcafb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.919261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda174e-027a-48d1-900a-4dc6ddcafb1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.920176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda174e-027a-48d1-900a-4dc6ddcafb1b None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=4d055337c9a642bd9b8b5a60aacb11cd) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.920696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda174e-027a-48d1-900a-4dc6ddcafb1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.922310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda174e-027a-48d1-900a-4dc6ddcafb1b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.926573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9e217-c20c-4ff9-82cf-4a92b34b1d69 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:26:59.928374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 282/534] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/role_assignments?user.id=4d055337c9a642bd9b8b5a60aacb11cd&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:59.929395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda174e-027a-48d1-900a-4dc6ddcafb1b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:26:59.965961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ae14-dba6-4b48-80b5-b00f4eac6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:26:59.966500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ae14-dba6-4b48-80b5-b00f4eac6622 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:26:59.966785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ae14-dba6-4b48-80b5-b00f4eac6622 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:26:59.967086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ae14-dba6-4b48-80b5-b00f4eac6622 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:26:59.967805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ae14-dba6-4b48-80b5-b00f4eac6622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:26:59.968117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ae14-dba6-4b48-80b5-b00f4eac6622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:26:59.970407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ae14-dba6-4b48-80b5-b00f4eac6622 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:26:59.989332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:26:59.995321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 253/535] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:26:59.997113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ae14-dba6-4b48-80b5-b00f4eac6622 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.043826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda174e-027a-48d1-900a-4dc6ddcafb1b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.082040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a22d1-497b-450e-a4da-016a1dfb6c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.083192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a22d1-497b-450e-a4da-016a1dfb6c87 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.083667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a22d1-497b-450e-a4da-016a1dfb6c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.084137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a22d1-497b-450e-a4da-016a1dfb6c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.096093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a22d1-497b-450e-a4da-016a1dfb6c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.098123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a22d1-497b-450e-a4da-016a1dfb6c87 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.111946 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ae14-dba6-4b48-80b5-b00f4eac6622 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ef8a22d1-497b-450e-a4da-016a1dfb6c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:00.115496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:00.116377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:00.117198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:00.117198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:00.117198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:00.119271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 283/536] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:00.128213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a22d1-497b-450e-a4da-016a1dfb6c87 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.131342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.166667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348b45d-9344-43bf-9da8-fadfc766c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.167317 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348b45d-9344-43bf-9da8-fadfc766c858 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.167598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348b45d-9344-43bf-9da8-fadfc766c858 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.167875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348b45d-9344-43bf-9da8-fadfc766c858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.168637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348b45d-9344-43bf-9da8-fadfc766c858 None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=4a128a6b32fd4a54ad0146551fe77879) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:00.168953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348b45d-9344-43bf-9da8-fadfc766c858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.170433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348b45d-9344-43bf-9da8-fadfc766c858 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.185200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 254/537] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:26:59 2022] GET /identity/v3/role_assignments?user.id=4a128a6b32fd4a54ad0146551fe77879&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:00.256757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a22d1-497b-450e-a4da-016a1dfb6c87 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.257150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fbeee-a3aa-4df7-99c7-c9442b3482fb None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.257441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fbeee-a3aa-4df7-99c7-c9442b3482fb None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.257724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fbeee-a3aa-4df7-99c7-c9442b3482fb None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.260574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.261075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 255/538] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:00.267198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f705b8c-625e-4edb-b8b7-f00043236aba None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.267500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f705b8c-625e-4edb-b8b7-f00043236aba None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.267757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f705b8c-625e-4edb-b8b7-f00043236aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.290127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4f705b8c-625e-4edb-b8b7-f00043236aba None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:00.291704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4f705b8c-625e-4edb-b8b7-f00043236aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:00.300153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f6f9d-be42-4175-984b-60c2a7294ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.300776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6f9d-be42-4175-984b-60c2a7294ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.301090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6f9d-be42-4175-984b-60c2a7294ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.302198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f6f9d-be42-4175-984b-60c2a7294ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.302865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6f9d-be42-4175-984b-60c2a7294ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:00.303269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6f9d-be42-4175-984b-60c2a7294ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.304791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f6f9d-be42-4175-984b-60c2a7294ac0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.318423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 284/539] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:00.328208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f6f9d-be42-4175-984b-60c2a7294ac0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.386959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 256/540] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:00.456271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f6f9d-be42-4175-984b-60c2a7294ac0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.503840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f4cdb-c39a-49f7-9498-332c7277a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.504480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f4cdb-c39a-49f7-9498-332c7277a06e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.504760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f4cdb-c39a-49f7-9498-332c7277a06e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.505035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f4cdb-c39a-49f7-9498-332c7277a06e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.517229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f4cdb-c39a-49f7-9498-332c7277a06e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.518683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f4cdb-c39a-49f7-9498-332c7277a06e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-838f4cdb-c39a-49f7-9498-332c7277a06e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:00.533578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:00.534451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:00.535723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:00.535723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:00.535723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:00.535723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:00.535723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:00.535723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:00.535723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:00.535723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:00.535723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 285/541] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:00.540513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f705b8c-625e-4edb-b8b7-f00043236aba None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.670082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f705b8c-625e-4edb-b8b7-f00043236aba None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.689220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.707668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f4cdb-c39a-49f7-9498-332c7277a06e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.722528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03bbb2-aae0-4f61-b591-944f97582d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.723221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03bbb2-aae0-4f61-b591-944f97582d4d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.723442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03bbb2-aae0-4f61-b591-944f97582d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.723718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03bbb2-aae0-4f61-b591-944f97582d4d None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.724426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03bbb2-aae0-4f61-b591-944f97582d4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:00.724734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03bbb2-aae0-4f61-b591-944f97582d4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:00.726298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03bbb2-aae0-4f61-b591-944f97582d4d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:00.743789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 257/542] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:00.748339 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:00.749093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03bbb2-aae0-4f61-b591-944f97582d4d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:00.891420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f4cdb-c39a-49f7-9498-332c7277a06e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.941658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03bbb2-aae0-4f61-b591-944f97582d4d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:00.958082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fc383-8c63-4ada-bd0f-09ddb51e3a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:00.958728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fc383-8c63-4ada-bd0f-09ddb51e3a6d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:00.959029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fc383-8c63-4ada-bd0f-09ddb51e3a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:00.959304 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fc383-8c63-4ada-bd0f-09ddb51e3a6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:00.981266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fc383-8c63-4ada-bd0f-09ddb51e3a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4d1fc383-8c63-4ada-bd0f-09ddb51e3a6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:00.987002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:00.987855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:00.988635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:00.997359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 286/543] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:01.006545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fc383-8c63-4ada-bd0f-09ddb51e3a6d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.017041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6a708-ee3d-4f21-b7f3-230e4bab98ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.017657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6a708-ee3d-4f21-b7f3-230e4bab98ef None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.017936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6a708-ee3d-4f21-b7f3-230e4bab98ef None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.018206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6a708-ee3d-4f21-b7f3-230e4bab98ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.018965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6a708-ee3d-4f21-b7f3-230e4bab98ef None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=a7a82c500de745c0b55df44b7f641706) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:01.019280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6a708-ee3d-4f21-b7f3-230e4bab98ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.021429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6a708-ee3d-4f21-b7f3-230e4bab98ef None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.034491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 258/544] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:00 2022] GET /identity/v3/role_assignments?user.id=a7a82c500de745c0b55df44b7f641706&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:01.123244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:01.141004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fc383-8c63-4ada-bd0f-09ddb51e3a6d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.187075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18375a-dc26-482a-8448-2940afb26c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.187752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18375a-dc26-482a-8448-2940afb26c99 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.188035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18375a-dc26-482a-8448-2940afb26c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.188368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18375a-dc26-482a-8448-2940afb26c99 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.189558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18375a-dc26-482a-8448-2940afb26c99 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:01.189861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18375a-dc26-482a-8448-2940afb26c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.191285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18375a-dc26-482a-8448-2940afb26c99 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.204018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 287/545] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:01.209815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6a708-ee3d-4f21-b7f3-230e4bab98ef None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.250004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:01.258610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd631a71-3445-43e8-a38d-53f72d7c07ff None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.258914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd631a71-3445-43e8-a38d-53f72d7c07ff None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.259220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd631a71-3445-43e8-a38d-53f72d7c07ff None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.266367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 288/546] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:01.268013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b77db-a063-41a2-bc24-26f980450160 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.268299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b77db-a063-41a2-bc24-26f980450160 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.268574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b77db-a063-41a2-bc24-26f980450160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.290120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-648b77db-a063-41a2-bc24-26f980450160 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:01.291336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-648b77db-a063-41a2-bc24-26f980450160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:01.374072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6a708-ee3d-4f21-b7f3-230e4bab98ef None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.406593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 289/547] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 26 15:27:01.420269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064de0e9-dcb6-457d-8a88-20d32434b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.420914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064de0e9-dcb6-457d-8a88-20d32434b581 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.421202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064de0e9-dcb6-457d-8a88-20d32434b581 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.421483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064de0e9-dcb6-457d-8a88-20d32434b581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.438858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064de0e9-dcb6-457d-8a88-20d32434b581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.440492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064de0e9-dcb6-457d-8a88-20d32434b581 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-064de0e9-dcb6-457d-8a88-20d32434b581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:01.459516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:01.460453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:01.461278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:01.461278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:01.461278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:01.461278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 259/548] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:01.466350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b77db-a063-41a2-bc24-26f980450160 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.589544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:01.622636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b77db-a063-41a2-bc24-26f980450160 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.665446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7fb60-ba81-4282-9290-5a7b9f44a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.665983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7fb60-ba81-4282-9290-5a7b9f44a0bc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.666266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7fb60-ba81-4282-9290-5a7b9f44a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.666542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7fb60-ba81-4282-9290-5a7b9f44a0bc None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.671367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7fb60-ba81-4282-9290-5a7b9f44a0bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:01.671690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7fb60-ba81-4282-9290-5a7b9f44a0bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.673616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7fb60-ba81-4282-9290-5a7b9f44a0bc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.691818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 290/549] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:01.697308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064de0e9-dcb6-457d-8a88-20d32434b581 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.791404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7fb60-ba81-4282-9290-5a7b9f44a0bc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.817586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064de0e9-dcb6-457d-8a88-20d32434b581 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:01.819262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:01.854202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b101aa-9dcf-47d6-9a04-26c3120d40d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:01.854835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b101aa-9dcf-47d6-9a04-26c3120d40d1 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:01.855158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b101aa-9dcf-47d6-9a04-26c3120d40d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:01.855437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b101aa-9dcf-47d6-9a04-26c3120d40d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:01.863119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b101aa-9dcf-47d6-9a04-26c3120d40d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:01.864581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b101aa-9dcf-47d6-9a04-26c3120d40d1 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-d6b101aa-9dcf-47d6-9a04-26c3120d40d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:01.877657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:01.879138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:01.880177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 260/550] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:01.884562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b101aa-9dcf-47d6-9a04-26c3120d40d1 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:01.990428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b101aa-9dcf-47d6-9a04-26c3120d40d1 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.031092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffffc-ca45-427d-add5-dc903b3dc5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.031092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffffc-ca45-427d-add5-dc903b3dc5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.031092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffffc-ca45-427d-add5-dc903b3dc5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.031092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffffc-ca45-427d-add5-dc903b3dc5a5 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.031506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ffffc-ca45-427d-add5-dc903b3dc5a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:02.031506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ffffc-ca45-427d-add5-dc903b3dc5a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:02.031506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ffffc-ca45-427d-add5-dc903b3dc5a5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:02.036008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7fb60-ba81-4282-9290-5a7b9f44a0bc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.058523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 261/551] 10.222.0.89 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:02.064206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffffc-ca45-427d-add5-dc903b3dc5a5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.078626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606c13-e9a7-44f1-8a31-ea6a024aabbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.079562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.080336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606c13-e9a7-44f1-8a31-ea6a024aabbb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.080827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606c13-e9a7-44f1-8a31-ea6a024aabbb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.081286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606c13-e9a7-44f1-8a31-ea6a024aabbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.090518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.100238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d606c13-e9a7-44f1-8a31-ea6a024aabbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2d606c13-e9a7-44f1-8a31-ea6a024aabbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:02.106295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:02.107323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:02.108399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:02.109018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 291/552] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:02.116009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606c13-e9a7-44f1-8a31-ea6a024aabbb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.266771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffffc-ca45-427d-add5-dc903b3dc5a5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.301179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606c13-e9a7-44f1-8a31-ea6a024aabbb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.305204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fe8b5-60cb-45ef-985e-ff8ea49de0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.305545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fe8b5-60cb-45ef-985e-ff8ea49de0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.305824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fe8b5-60cb-45ef-985e-ff8ea49de0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.306094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fe8b5-60cb-45ef-985e-ff8ea49de0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.363970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc517-effd-4021-8a14-630250d9676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.364589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc517-effd-4021-8a14-630250d9676c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.364870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc517-effd-4021-8a14-630250d9676c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.365146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cc517-effd-4021-8a14-630250d9676c None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.367185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc517-effd-4021-8a14-630250d9676c None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:02.367496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc517-effd-4021-8a14-630250d9676c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:02.368892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cc517-effd-4021-8a14-630250d9676c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:02.388247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 292/553] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:02.395507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc517-effd-4021-8a14-630250d9676c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.430432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fe8b5-60cb-45ef-985e-ff8ea49de0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:02.432781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fe8b5-60cb-45ef-985e-ff8ea49de0d7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:02.437461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.468636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.519288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cc517-effd-4021-8a14-630250d9676c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.555989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03273d6-9342-4501-a2ba-35ac9d65ed07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.556433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03273d6-9342-4501-a2ba-35ac9d65ed07 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.556718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03273d6-9342-4501-a2ba-35ac9d65ed07 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.556993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03273d6-9342-4501-a2ba-35ac9d65ed07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.560780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 262/554] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:27:02.562364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9269d-f65b-428b-b93e-751e03b0ce60 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.562854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9269d-f65b-428b-b93e-751e03b0ce60 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.564213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9269d-f65b-428b-b93e-751e03b0ce60 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.566480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 263/555] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:02.567755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba856-8379-4d41-88de-029ad69b81e9 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.568046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba856-8379-4d41-88de-029ad69b81e9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.568320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aba856-8379-4d41-88de-029ad69b81e9 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.569641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 264/556] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:02.570315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba856-8379-4d41-88de-029ad69b81e9 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.571969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03273d6-9342-4501-a2ba-35ac9d65ed07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:02.573426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03273d6-9342-4501-a2ba-35ac9d65ed07 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d03273d6-9342-4501-a2ba-35ac9d65ed07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:02.589436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:02.590374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:02.591637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:02.591637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:02.591637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:02.591637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 293/557] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:02.591873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9a643-d92c-45a5-bd40-dbd362e20c86 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.592113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9a643-d92c-45a5-bd40-dbd362e20c86 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.592269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9a643-d92c-45a5-bd40-dbd362e20c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.611220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-60b9a643-d92c-45a5-bd40-dbd362e20c86 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:02.612544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-60b9a643-d92c-45a5-bd40-dbd362e20c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:02.682448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 294/558] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:02.684032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6d91-fc39-4ff8-9bcb-b9b34f58f9e0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.684499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6d91-fc39-4ff8-9bcb-b9b34f58f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.684975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c6d91-fc39-4ff8-9bcb-b9b34f58f9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.696460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aba856-8379-4d41-88de-029ad69b81e9 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.699544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.704638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7b3c6d91-fc39-4ff8-9bcb-b9b34f58f9e0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:02.706022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7b3c6d91-fc39-4ff8-9bcb-b9b34f58f9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:02.742788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bae6e-b73e-4849-a5d6-7e677f7accc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.743786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bae6e-b73e-4849-a5d6-7e677f7accc6 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.744292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bae6e-b73e-4849-a5d6-7e677f7accc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.744768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bae6e-b73e-4849-a5d6-7e677f7accc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.750283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:02.757535 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bae6e-b73e-4849-a5d6-7e677f7accc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:02.759333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bae6e-b73e-4849-a5d6-7e677f7accc6 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-261bae6e-b73e-4849-a5d6-7e677f7accc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:02.779346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:02.780330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:02.781186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:02.781186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:02.781186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:02.783392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 265/559] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:02.784557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bae6e-b73e-4849-a5d6-7e677f7accc6 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.801147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 295/560] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:02.808644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c6d91-fc39-4ff8-9bcb-b9b34f58f9e0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.908080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bae6e-b73e-4849-a5d6-7e677f7accc6 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.947530 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd35c5-f6cb-46ee-b921-f987d06b8145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:02.948141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd35c5-f6cb-46ee-b921-f987d06b8145 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:02.948429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd35c5-f6cb-46ee-b921-f987d06b8145 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:02.949269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd35c5-f6cb-46ee-b921-f987d06b8145 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:02.949951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd35c5-f6cb-46ee-b921-f987d06b8145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:02.950262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd35c5-f6cb-46ee-b921-f987d06b8145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:02.951803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd35c5-f6cb-46ee-b921-f987d06b8145 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:02.966138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 266/561] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:02.967490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd35c5-f6cb-46ee-b921-f987d06b8145 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:02.995024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c6d91-fc39-4ff8-9bcb-b9b34f58f9e0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:02.995900 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.032569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fa8df-4e92-4b86-8bca-036c0762b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.033104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fa8df-4e92-4b86-8bca-036c0762b267 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.033387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fa8df-4e92-4b86-8bca-036c0762b267 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.033707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fa8df-4e92-4b86-8bca-036c0762b267 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.034363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fa8df-4e92-4b86-8bca-036c0762b267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:03.034665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fa8df-4e92-4b86-8bca-036c0762b267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.036105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fa8df-4e92-4b86-8bca-036c0762b267 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.048416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 296/562] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:03.049319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fa8df-4e92-4b86-8bca-036c0762b267 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.082142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.109887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd35c5-f6cb-46ee-b921-f987d06b8145 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.156587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f52282-4aa6-4f7e-a367-b899e3c076cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.157262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f52282-4aa6-4f7e-a367-b899e3c076cd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.157550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f52282-4aa6-4f7e-a367-b899e3c076cd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.157832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f52282-4aa6-4f7e-a367-b899e3c076cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.161552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fa8df-4e92-4b86-8bca-036c0762b267 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.168263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f52282-4aa6-4f7e-a367-b899e3c076cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-f1f52282-4aa6-4f7e-a367-b899e3c076cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:03.173188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:03.174370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:03.175614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 267/563] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:03.179804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f52282-4aa6-4f7e-a367-b899e3c076cd None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.213391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a643c-5d8d-4cc1-8d9e-24ec476a11bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.214327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a643c-5d8d-4cc1-8d9e-24ec476a11bb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.214776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a643c-5d8d-4cc1-8d9e-24ec476a11bb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.215241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a643c-5d8d-4cc1-8d9e-24ec476a11bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.223614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a643c-5d8d-4cc1-8d9e-24ec476a11bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.225222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a643c-5d8d-4cc1-8d9e-24ec476a11bb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c09a643c-5d8d-4cc1-8d9e-24ec476a11bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:03.238088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:03.239255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:03.240403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:03.242347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 297/564] 10.222.0.89 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:03.243505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a643c-5d8d-4cc1-8d9e-24ec476a11bb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.268781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.298990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f52282-4aa6-4f7e-a367-b899e3c076cd None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.335533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86501f-fa67-4a97-8e4c-3c35d65bfabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.336413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86501f-fa67-4a97-8e4c-3c35d65bfabb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.336957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86501f-fa67-4a97-8e4c-3c35d65bfabb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.337257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86501f-fa67-4a97-8e4c-3c35d65bfabb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.345192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86501f-fa67-4a97-8e4c-3c35d65bfabb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.346647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86501f-fa67-4a97-8e4c-3c35d65bfabb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.347084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.357169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a643c-5d8d-4cc1-8d9e-24ec476a11bb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-9b86501f-fa67-4a97-8e4c-3c35d65bfabb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:03.358628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:03.359643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 268/565] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:03.360587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86501f-fa67-4a97-8e4c-3c35d65bfabb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.397031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72a7e-c95b-4900-b4c4-f03caa03f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.397666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72a7e-c95b-4900-b4c4-f03caa03f748 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.397947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72a7e-c95b-4900-b4c4-f03caa03f748 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.398223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72a7e-c95b-4900-b4c4-f03caa03f748 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.409309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72a7e-c95b-4900-b4c4-f03caa03f748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b4a72a7e-c95b-4900-b4c4-f03caa03f748 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:03.414434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:03.415547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 298/566] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:03.416530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72a7e-c95b-4900-b4c4-f03caa03f748 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.470269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86501f-fa67-4a97-8e4c-3c35d65bfabb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.503329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058558be-eed4-483b-8b40-2f52267aab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.503933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058558be-eed4-483b-8b40-2f52267aab34 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.504214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058558be-eed4-483b-8b40-2f52267aab34 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.504491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058558be-eed4-483b-8b40-2f52267aab34 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.505163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058558be-eed4-483b-8b40-2f52267aab34 None admin] RBAC: Adding query filter params (name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:03.505469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058558be-eed4-483b-8b40-2f52267aab34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.506837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058558be-eed4-483b-8b40-2f52267aab34 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.508997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.513369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72a7e-c95b-4900-b4c4-f03caa03f748 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.517167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 269/567] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:03.517432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb542-db0e-4026-8328-2e90f9f69f22 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.517716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb542-db0e-4026-8328-2e90f9f69f22 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.517993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb542-db0e-4026-8328-2e90f9f69f22 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.519341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 270/568] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:03.519907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb542-db0e-4026-8328-2e90f9f69f22 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.548010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372682-89ba-46a9-86e2-92018a7ffa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.548747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372682-89ba-46a9-86e2-92018a7ffa09 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.549186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372682-89ba-46a9-86e2-92018a7ffa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.549407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15372682-89ba-46a9-86e2-92018a7ffa09 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.550127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15372682-89ba-46a9-86e2-92018a7ffa09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:03.550432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15372682-89ba-46a9-86e2-92018a7ffa09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.551881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15372682-89ba-46a9-86e2-92018a7ffa09 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.568971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 299/569] 10.222.0.89 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:03.569787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372682-89ba-46a9-86e2-92018a7ffa09 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.581276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.629559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb542-db0e-4026-8328-2e90f9f69f22 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.663099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7c71d-8a25-473c-89e7-ad36aff93b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.663699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7c71d-8a25-473c-89e7-ad36aff93b01 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.663979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7c71d-8a25-473c-89e7-ad36aff93b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.664252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7c71d-8a25-473c-89e7-ad36aff93b01 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.664954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7c71d-8a25-473c-89e7-ad36aff93b01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:03.665262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7c71d-8a25-473c-89e7-ad36aff93b01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.666709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7c71d-8a25-473c-89e7-ad36aff93b01 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.671181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15372682-89ba-46a9-86e2-92018a7ffa09 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.678414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 271/570] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:03.679228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7c71d-8a25-473c-89e7-ad36aff93b01 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.712392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11c7f3-1cfd-4abf-9145-50b82e54d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.713174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11c7f3-1cfd-4abf-9145-50b82e54d501 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.713524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11c7f3-1cfd-4abf-9145-50b82e54d501 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.713870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11c7f3-1cfd-4abf-9145-50b82e54d501 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.714659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11c7f3-1cfd-4abf-9145-50b82e54d501 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:03.715085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11c7f3-1cfd-4abf-9145-50b82e54d501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.716739 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11c7f3-1cfd-4abf-9145-50b82e54d501 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.730960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 300/571] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:03.730960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f202d-054c-472f-b837-897ea27dfe3b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.730960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f202d-054c-472f-b837-897ea27dfe3b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.730960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f202d-054c-472f-b837-897ea27dfe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.747493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.750191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5b2f202d-054c-472f-b837-897ea27dfe3b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:03.752258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5b2f202d-054c-472f-b837-897ea27dfe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:03.793506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7c71d-8a25-473c-89e7-ad36aff93b01 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.820918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.826767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 301/572] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:03.827815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f202d-054c-472f-b837-897ea27dfe3b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.841886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f765a3-3629-467b-9720-6fc5248724a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.842515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f765a3-3629-467b-9720-6fc5248724a4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.842793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f765a3-3629-467b-9720-6fc5248724a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.843100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f765a3-3629-467b-9720-6fc5248724a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.854034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f765a3-3629-467b-9720-6fc5248724a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:03.855549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f765a3-3629-467b-9720-6fc5248724a4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-f3f765a3-3629-467b-9720-6fc5248724a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:03.873860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:03.874911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:03.876626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:03.876626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:03.876626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:03.882794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 272/573] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:03.882794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f765a3-3629-467b-9720-6fc5248724a4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:03.940123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f202d-054c-472f-b837-897ea27dfe3b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.983849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbebe57-b922-4ad2-a9f0-153e5f52147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:03.984489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbebe57-b922-4ad2-a9f0-153e5f52147e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:03.984726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f765a3-3629-467b-9720-6fc5248724a4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:03.985688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbebe57-b922-4ad2-a9f0-153e5f52147e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:03.985688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbebe57-b922-4ad2-a9f0-153e5f52147e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:03.995549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:03.998443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbebe57-b922-4ad2-a9f0-153e5f52147e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.000136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbebe57-b922-4ad2-a9f0-153e5f52147e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-6dbebe57-b922-4ad2-a9f0-153e5f52147e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:04.015305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.016737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:04.017818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:04.017818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:04.017818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:04.019193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 302/574] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.019957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbebe57-b922-4ad2-a9f0-153e5f52147e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.027608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1ca5d-d250-48ac-9e99-09108a657931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.028858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1ca5d-d250-48ac-9e99-09108a657931 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.029324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1ca5d-d250-48ac-9e99-09108a657931 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.029801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1ca5d-d250-48ac-9e99-09108a657931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.031129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1ca5d-d250-48ac-9e99-09108a657931 None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=9df361aabe544b618c7c1c1d98b8751a) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:04.031628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1ca5d-d250-48ac-9e99-09108a657931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.033784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1ca5d-d250-48ac-9e99-09108a657931 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.051061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 273/575] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:03 2022] GET /identity/v3/role_assignments?user.id=9df361aabe544b618c7c1c1d98b8751a&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:04.051061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1ca5d-d250-48ac-9e99-09108a657931 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.089471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.146119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbebe57-b922-4ad2-a9f0-153e5f52147e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.173672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1ca5d-d250-48ac-9e99-09108a657931 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.182882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e65ad-9e9f-45ae-a505-d0b9fc45e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.183564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e65ad-9e9f-45ae-a505-d0b9fc45e38c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.183841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e65ad-9e9f-45ae-a505-d0b9fc45e38c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.184429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e65ad-9e9f-45ae-a505-d0b9fc45e38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.196476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e65ad-9e9f-45ae-a505-d0b9fc45e38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.197909 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e65ad-9e9f-45ae-a505-d0b9fc45e38c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-6d6e65ad-9e9f-45ae-a505-d0b9fc45e38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:04.213662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.214830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:04.215765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:04.215765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:04.215765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:04.215765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 303/576] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.215765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e65ad-9e9f-45ae-a505-d0b9fc45e38c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.225558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6ad08-362a-4e91-8746-3f855249ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.227035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ad08-362a-4e91-8746-3f855249ecdf None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.227324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ad08-362a-4e91-8746-3f855249ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.227626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ad08-362a-4e91-8746-3f855249ecdf None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.228655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6ad08-362a-4e91-8746-3f855249ecdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:04.228976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6ad08-362a-4e91-8746-3f855249ecdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.230720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6ad08-362a-4e91-8746-3f855249ecdf None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.244154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 274/577] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:04.245005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6ad08-362a-4e91-8746-3f855249ecdf None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.283624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.335752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e65ad-9e9f-45ae-a505-d0b9fc45e38c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.339009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.356242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6ad08-362a-4e91-8746-3f855249ecdf None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.374763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c340f3-2cd3-4c5c-89a5-bddbefe2ef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.375414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c340f3-2cd3-4c5c-89a5-bddbefe2ef8a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.376232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c340f3-2cd3-4c5c-89a5-bddbefe2ef8a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.376508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c340f3-2cd3-4c5c-89a5-bddbefe2ef8a None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.377165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c340f3-2cd3-4c5c-89a5-bddbefe2ef8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:04.377468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c340f3-2cd3-4c5c-89a5-bddbefe2ef8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.378840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c340f3-2cd3-4c5c-89a5-bddbefe2ef8a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.396054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 304/578] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:04.396054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c340f3-2cd3-4c5c-89a5-bddbefe2ef8a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.399990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c97ef5-3ad5-4e15-8e3b-d261fee6dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.400714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c97ef5-3ad5-4e15-8e3b-d261fee6dacc None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.401070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c97ef5-3ad5-4e15-8e3b-d261fee6dacc None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.401413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c97ef5-3ad5-4e15-8e3b-d261fee6dacc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.412974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c97ef5-3ad5-4e15-8e3b-d261fee6dacc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-a7c97ef5-3ad5-4e15-8e3b-d261fee6dacc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:04.417861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.419034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:04.420047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 275/579] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.421247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c97ef5-3ad5-4e15-8e3b-d261fee6dacc None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.515842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c340f3-2cd3-4c5c-89a5-bddbefe2ef8a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.523280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.531431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c97ef5-3ad5-4e15-8e3b-d261fee6dacc None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.553509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f57c32-1f14-409b-8165-debeca155994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.554126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f57c32-1f14-409b-8165-debeca155994 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.554414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f57c32-1f14-409b-8165-debeca155994 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.554687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f57c32-1f14-409b-8165-debeca155994 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.555369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f57c32-1f14-409b-8165-debeca155994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:04.555675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f57c32-1f14-409b-8165-debeca155994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.557046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f57c32-1f14-409b-8165-debeca155994 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.568241 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513ba9a-de24-4b63-8643-a8d559413962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.573518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513ba9a-de24-4b63-8643-a8d559413962 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.573670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 305/580] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:04.573762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513ba9a-de24-4b63-8643-a8d559413962 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.573762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513ba9a-de24-4b63-8643-a8d559413962 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.574008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f57c32-1f14-409b-8165-debeca155994 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.577393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513ba9a-de24-4b63-8643-a8d559413962 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.579429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513ba9a-de24-4b63-8643-a8d559413962 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-8513ba9a-de24-4b63-8643-a8d559413962 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:04.591643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.592783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 276/581] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.598906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513ba9a-de24-4b63-8643-a8d559413962 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.606630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.694585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f57c32-1f14-409b-8165-debeca155994 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.708516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513ba9a-de24-4b63-8643-a8d559413962 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.732915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095ddfa-47a4-40fc-af33-8abc74542805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.733755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095ddfa-47a4-40fc-af33-8abc74542805 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.734152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095ddfa-47a4-40fc-af33-8abc74542805 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.734556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095ddfa-47a4-40fc-af33-8abc74542805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.742779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095ddfa-47a4-40fc-af33-8abc74542805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.744382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095ddfa-47a4-40fc-af33-8abc74542805 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.747426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651b8f6-e1d6-44da-8ef3-69fd7d47a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.748125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651b8f6-e1d6-44da-8ef3-69fd7d47a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.748484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651b8f6-e1d6-44da-8ef3-69fd7d47a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.748835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651b8f6-e1d6-44da-8ef3-69fd7d47a3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.749592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651b8f6-e1d6-44da-8ef3-69fd7d47a3f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:04.749974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651b8f6-e1d6-44da-8ef3-69fd7d47a3f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.752166 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651b8f6-e1d6-44da-8ef3-69fd7d47a3f8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e095ddfa-47a4-40fc-af33-8abc74542805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:04.757639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.758721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.759756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:04.759756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:04.759756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:04.759756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:04.759756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:04.759756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:04.759756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:04.759756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:04.759756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 306/582] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.760299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095ddfa-47a4-40fc-af33-8abc74542805 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.767841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 277/583] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:04.768501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651b8f6-e1d6-44da-8ef3-69fd7d47a3f8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.792011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.863307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:04.881679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095ddfa-47a4-40fc-af33-8abc74542805 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.892992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651b8f6-e1d6-44da-8ef3-69fd7d47a3f8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:04.921498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace65755-dab9-4fad-a6d8-091246a4786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.922305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace65755-dab9-4fad-a6d8-091246a4786e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.922458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace65755-dab9-4fad-a6d8-091246a4786e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.922719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace65755-dab9-4fad-a6d8-091246a4786e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.930082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8580ecd-042d-44c6-b629-90614328f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:04.930696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8580ecd-042d-44c6-b629-90614328f7ed None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:04.931013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8580ecd-042d-44c6-b629-90614328f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:04.931293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8580ecd-042d-44c6-b629-90614328f7ed None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:04.931401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace65755-dab9-4fad-a6d8-091246a4786e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.932030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8580ecd-042d-44c6-b629-90614328f7ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:04.932344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8580ecd-042d-44c6-b629-90614328f7ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:04.932807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace65755-dab9-4fad-a6d8-091246a4786e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.933775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8580ecd-042d-44c6-b629-90614328f7ed None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ace65755-dab9-4fad-a6d8-091246a4786e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:04.945508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:04.946494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 307/584] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:04.947934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace65755-dab9-4fad-a6d8-091246a4786e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:04.961651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 278/585] 10.222.0.89 () {56 vars in 1137 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:04.961651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8580ecd-042d-44c6-b629-90614328f7ed None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.050150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.072312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace65755-dab9-4fad-a6d8-091246a4786e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.079419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8580ecd-042d-44c6-b629-90614328f7ed None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.111138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dc3c8-2ef9-4b6d-8788-1480a04c37f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.111826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dc3c8-2ef9-4b6d-8788-1480a04c37f9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.112184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dc3c8-2ef9-4b6d-8788-1480a04c37f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.112465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dc3c8-2ef9-4b6d-8788-1480a04c37f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.113191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0dc3c8-2ef9-4b6d-8788-1480a04c37f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.113554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0dc3c8-2ef9-4b6d-8788-1480a04c37f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.115092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0dc3c8-2ef9-4b6d-8788-1480a04c37f9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.118662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e13d-46f4-46df-84f9-bd54eb6376eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.119635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e13d-46f4-46df-84f9-bd54eb6376eb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.120101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e13d-46f4-46df-84f9-bd54eb6376eb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.120559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434e13d-46f4-46df-84f9-bd54eb6376eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.130016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 308/586] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.130893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dc3c8-2ef9-4b6d-8788-1480a04c37f9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.138184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.141013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434e13d-46f4-46df-84f9-bd54eb6376eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.143405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434e13d-46f4-46df-84f9-bd54eb6376eb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-e434e13d-46f4-46df-84f9-bd54eb6376eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:05.162373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.163424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:05.164513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:05.164513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.164513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:05.164513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 279/587] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.164743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e13d-46f4-46df-84f9-bd54eb6376eb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.263119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dc3c8-2ef9-4b6d-8788-1480a04c37f9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.290157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434e13d-46f4-46df-84f9-bd54eb6376eb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.302762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e491-da9c-49b4-915f-cc35e35bae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.303436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e491-da9c-49b4-915f-cc35e35bae44 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.303700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e491-da9c-49b4-915f-cc35e35bae44 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.303971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e491-da9c-49b4-915f-cc35e35bae44 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.304715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e491-da9c-49b4-915f-cc35e35bae44 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.305023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e491-da9c-49b4-915f-cc35e35bae44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.306488 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e491-da9c-49b4-915f-cc35e35bae44 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.321316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.326860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 309/588] 10.222.0.89 () {56 vars in 1137 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.327605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e491-da9c-49b4-915f-cc35e35bae44 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.337269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12394387-795a-4d7f-aa83-501428dab90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.338232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12394387-795a-4d7f-aa83-501428dab90b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.338717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12394387-795a-4d7f-aa83-501428dab90b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.339219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12394387-795a-4d7f-aa83-501428dab90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.350755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12394387-795a-4d7f-aa83-501428dab90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.352467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12394387-795a-4d7f-aa83-501428dab90b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-12394387-795a-4d7f-aa83-501428dab90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:05.366991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.367955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:05.368811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:05.368811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.368811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:05.372897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 280/589] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.373657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12394387-795a-4d7f-aa83-501428dab90b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.397365 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.446661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e491-da9c-49b4-915f-cc35e35bae44 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.486352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a84282-1453-4530-89d5-57c9b32a0b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.487061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a84282-1453-4530-89d5-57c9b32a0b06 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.487346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a84282-1453-4530-89d5-57c9b32a0b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.487623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a84282-1453-4530-89d5-57c9b32a0b06 None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/5cbda75c38b04e6c89f17e655eb4f737/roles/90c85626d318449cb55d5c2bc0b2e18d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.493778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12394387-795a-4d7f-aa83-501428dab90b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.506015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a84282-1453-4530-89d5-57c9b32a0b06 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=5cbda75c38b04e6c89f17e655eb4f737, role_id=90c85626d318449cb55d5c2bc0b2e18d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.507594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a84282-1453-4530-89d5-57c9b32a0b06 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.529157 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 310/590] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:05 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/5cbda75c38b04e6c89f17e655eb4f737/roles/90c85626d318449cb55d5c2bc0b2e18d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:05.529157 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a84282-1453-4530-89d5-57c9b32a0b06 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.545156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73343-ec9f-4cb0-a21a-989a6d819478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.546175 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73343-ec9f-4cb0-a21a-989a6d819478 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.546584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73343-ec9f-4cb0-a21a-989a6d819478 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.546989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c73343-ec9f-4cb0-a21a-989a6d819478 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.548705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73343-ec9f-4cb0-a21a-989a6d819478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.549362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73343-ec9f-4cb0-a21a-989a6d819478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.551571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c73343-ec9f-4cb0-a21a-989a6d819478 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.580385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 281/591] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.581642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73343-ec9f-4cb0-a21a-989a6d819478 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.646276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.659189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a84282-1453-4530-89d5-57c9b32a0b06 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.675526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.702017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733287f9-0a51-40a1-81a3-d46b63b048cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.702949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733287f9-0a51-40a1-81a3-d46b63b048cc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.703379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733287f9-0a51-40a1-81a3-d46b63b048cc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.704341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733287f9-0a51-40a1-81a3-d46b63b048cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.718892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733287f9-0a51-40a1-81a3-d46b63b048cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.721266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733287f9-0a51-40a1-81a3-d46b63b048cc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.728163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c73343-ec9f-4cb0-a21a-989a6d819478 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-733287f9-0a51-40a1-81a3-d46b63b048cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:05.737897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.738997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:05.739926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:05.739926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:05.739926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:05.743045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 311/592] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.744083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733287f9-0a51-40a1-81a3-d46b63b048cc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.773048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b5aac-89d9-46bf-ba4e-243b64c7d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.773648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b5aac-89d9-46bf-ba4e-243b64c7d9bb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.773939 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b5aac-89d9-46bf-ba4e-243b64c7d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.774220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b5aac-89d9-46bf-ba4e-243b64c7d9bb None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.774876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b5aac-89d9-46bf-ba4e-243b64c7d9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.775210 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b5aac-89d9-46bf-ba4e-243b64c7d9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.777380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b5aac-89d9-46bf-ba4e-243b64c7d9bb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.790665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 282/593] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.794956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b5aac-89d9-46bf-ba4e-243b64c7d9bb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.866300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733287f9-0a51-40a1-81a3-d46b63b048cc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.904208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c6e41-8982-4904-8aca-28d197470953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.905073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c6e41-8982-4904-8aca-28d197470953 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.905533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c6e41-8982-4904-8aca-28d197470953 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.905978 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c6e41-8982-4904-8aca-28d197470953 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.908771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.913928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b5aac-89d9-46bf-ba4e-243b64c7d9bb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:05.916164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c6e41-8982-4904-8aca-28d197470953 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.917876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c6e41-8982-4904-8aca-28d197470953 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-077c6e41-8982-4904-8aca-28d197470953 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:05.931884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:05.932868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:05.934260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:05.938146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 312/594] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:05.939127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c6e41-8982-4904-8aca-28d197470953 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:05.967109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e3c59-8de6-45c0-9647-90b610f5cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:05.968449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e3c59-8de6-45c0-9647-90b610f5cebf None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:05.968992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e3c59-8de6-45c0-9647-90b610f5cebf None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:05.970313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:05.971155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e3c59-8de6-45c0-9647-90b610f5cebf None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:05.973109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e3c59-8de6-45c0-9647-90b610f5cebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:05.973662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e3c59-8de6-45c0-9647-90b610f5cebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:05.977002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e3c59-8de6-45c0-9647-90b610f5cebf None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:05.995527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 283/595] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:05.997250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e3c59-8de6-45c0-9647-90b610f5cebf None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.069259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c6e41-8982-4904-8aca-28d197470953 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.109682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f8529-906a-4535-9bc7-0d7580e4271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.111041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8529-906a-4535-9bc7-0d7580e4271e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.111385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8529-906a-4535-9bc7-0d7580e4271e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.111700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8529-906a-4535-9bc7-0d7580e4271e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.117798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e3c59-8de6-45c0-9647-90b610f5cebf None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.119401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f8529-906a-4535-9bc7-0d7580e4271e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.121079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f8529-906a-4535-9bc7-0d7580e4271e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ac6f8529-906a-4535-9bc7-0d7580e4271e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:06.135419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:06.136564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:06.137472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:06.137472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:06.137472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:06.137472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:06.137472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:06.137472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:06.137472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:06.137472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:06.137472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 313/596] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:06.138041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57654a22-33f1-4285-bf30-4f938c4bcd14 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.138374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57654a22-33f1-4285-bf30-4f938c4bcd14 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.138655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57654a22-33f1-4285-bf30-4f938c4bcd14 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.140075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 314/597] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:06.145161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57654a22-33f1-4285-bf30-4f938c4bcd14 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.163925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee33b73-17e7-424c-bc16-e60009aeff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.164452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee33b73-17e7-424c-bc16-e60009aeff34 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.164733 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee33b73-17e7-424c-bc16-e60009aeff34 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.165005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee33b73-17e7-424c-bc16-e60009aeff34 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.165738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee33b73-17e7-424c-bc16-e60009aeff34 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.166040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee33b73-17e7-424c-bc16-e60009aeff34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.167516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee33b73-17e7-424c-bc16-e60009aeff34 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.185955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 284/598] 10.222.0.89 () {56 vars in 1139 bytes} [Fri Aug 26 15:27:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.186801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee33b73-17e7-424c-bc16-e60009aeff34 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.206473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.251843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.271969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57654a22-33f1-4285-bf30-4f938c4bcd14 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.302954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee33b73-17e7-424c-bc16-e60009aeff34 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.309768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7b66-6b9a-43ad-9e38-a02e9f3042b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.310637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7b66-6b9a-43ad-9e38-a02e9f3042b2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.311094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7b66-6b9a-43ad-9e38-a02e9f3042b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.311511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7b66-6b9a-43ad-9e38-a02e9f3042b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.319257 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf7b66-6b9a-43ad-9e38-a02e9f3042b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.320927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf7b66-6b9a-43ad-9e38-a02e9f3042b2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-aebf7b66-6b9a-43ad-9e38-a02e9f3042b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:06.333247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:06.334327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:06.335454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:06.335454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:06.335454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:06.335454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:06.335454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:06.335454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:06.335454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:06.335454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:06.337136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 315/599] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:06.338458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a5f80-02b5-4129-97e5-de6f370e0328 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.338740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a5f80-02b5-4129-97e5-de6f370e0328 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.339036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a5f80-02b5-4129-97e5-de6f370e0328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.347370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38970-beea-4f1c-92fc-0d2cbd611665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.348640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38970-beea-4f1c-92fc-0d2cbd611665 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.349036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38970-beea-4f1c-92fc-0d2cbd611665 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.349442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38970-beea-4f1c-92fc-0d2cbd611665 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.350584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a38970-beea-4f1c-92fc-0d2cbd611665 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.351134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a38970-beea-4f1c-92fc-0d2cbd611665 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.353608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a38970-beea-4f1c-92fc-0d2cbd611665 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.366069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-981a5f80-02b5-4129-97e5-de6f370e0328 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:06.368364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-981a5f80-02b5-4129-97e5-de6f370e0328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:06.372411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 285/600] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.373746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38970-beea-4f1c-92fc-0d2cbd611665 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.463057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 316/601] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:06.463057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a5f80-02b5-4129-97e5-de6f370e0328 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.480304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.511541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38970-beea-4f1c-92fc-0d2cbd611665 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.533276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.561420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a5f80-02b5-4129-97e5-de6f370e0328 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.563520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e761b4-70df-4d46-8774-4bb9151b0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.565224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e761b4-70df-4d46-8774-4bb9151b0de7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.565653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e761b4-70df-4d46-8774-4bb9151b0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.566069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e761b4-70df-4d46-8774-4bb9151b0de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.580838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e761b4-70df-4d46-8774-4bb9151b0de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.583138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e761b4-70df-4d46-8774-4bb9151b0de7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.602764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbb9ab-c2c4-4abe-ae9d-38a286e8e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-41e761b4-70df-4d46-8774-4bb9151b0de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:06.603073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:06.604146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:06.605237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:06.605237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:06.605237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:06.605461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb9ab-c2c4-4abe-ae9d-38a286e8e8fc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.605461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb9ab-c2c4-4abe-ae9d-38a286e8e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.605461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb9ab-c2c4-4abe-ae9d-38a286e8e8fc None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.605461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb9ab-c2c4-4abe-ae9d-38a286e8e8fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.605461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb9ab-c2c4-4abe-ae9d-38a286e8e8fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.606522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb9ab-c2c4-4abe-ae9d-38a286e8e8fc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.607429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 286/602] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:06.608329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e761b4-70df-4d46-8774-4bb9151b0de7 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.631619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 317/603] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.632632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbb9ab-c2c4-4abe-ae9d-38a286e8e8fc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.743579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e761b4-70df-4d46-8774-4bb9151b0de7 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.756867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbb9ab-c2c4-4abe-ae9d-38a286e8e8fc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.774205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.783358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9aa79-26c9-4bc4-bf01-2dc6edc3626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.784556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9aa79-26c9-4bc4-bf01-2dc6edc3626f None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.784556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9aa79-26c9-4bc4-bf01-2dc6edc3626f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.784760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9aa79-26c9-4bc4-bf01-2dc6edc3626f None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/4a128a6b32fd4a54ad0146551fe77879/roles/90c85626d318449cb55d5c2bc0b2e18d` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.800997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9aa79-26c9-4bc4-bf01-2dc6edc3626f None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=4a128a6b32fd4a54ad0146551fe77879, role_id=90c85626d318449cb55d5c2bc0b2e18d)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.802594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9aa79-26c9-4bc4-bf01-2dc6edc3626f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.814573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec26a3-2d50-4e8e-b3e4-ea032813811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:06.815623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec26a3-2d50-4e8e-b3e4-ea032813811a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:06.816100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec26a3-2d50-4e8e-b3e4-ea032813811a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:06.816582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec26a3-2d50-4e8e-b3e4-ea032813811a None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:06.817257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 287/604] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:06 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/4a128a6b32fd4a54ad0146551fe77879/roles/90c85626d318449cb55d5c2bc0b2e18d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:06.817686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec26a3-2d50-4e8e-b3e4-ea032813811a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:06.818179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec26a3-2d50-4e8e-b3e4-ea032813811a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:06.818280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9aa79-26c9-4bc4-bf01-2dc6edc3626f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.819895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec26a3-2d50-4e8e-b3e4-ea032813811a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:06.821726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:06.840195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 318/605] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:06.841120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec26a3-2d50-4e8e-b3e4-ea032813811a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:06.974574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9aa79-26c9-4bc4-bf01-2dc6edc3626f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:06.993252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec26a3-2d50-4e8e-b3e4-ea032813811a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.025918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a5bc-6bb3-4041-8f9a-ddc92a3de1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.026560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a5bc-6bb3-4041-8f9a-ddc92a3de1cb None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.026853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a5bc-6bb3-4041-8f9a-ddc92a3de1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.027142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a5bc-6bb3-4041-8f9a-ddc92a3de1cb None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/4d055337c9a642bd9b8b5a60aacb11cd/roles/90c85626d318449cb55d5c2bc0b2e18d` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.045240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5a5bc-6bb3-4041-8f9a-ddc92a3de1cb None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=4d055337c9a642bd9b8b5a60aacb11cd, role_id=90c85626d318449cb55d5c2bc0b2e18d)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.046822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5a5bc-6bb3-4041-8f9a-ddc92a3de1cb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.054836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe8bf6-7b9a-4db1-ad34-e13f4ab56ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.054836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe8bf6-7b9a-4db1-ad34-e13f4ab56ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.054836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe8bf6-7b9a-4db1-ad34-e13f4ab56ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.055442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe8bf6-7b9a-4db1-ad34-e13f4ab56ed3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.071586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 288/606] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:06 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/4d055337c9a642bd9b8b5a60aacb11cd/roles/90c85626d318449cb55d5c2bc0b2e18d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:07.072540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a5bc-6bb3-4041-8f9a-ddc92a3de1cb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.074705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe8bf6-7b9a-4db1-ad34-e13f4ab56ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-fafe8bf6-7b9a-4db1-ad34-e13f4ab56ed3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:07.081919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:07.083006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:07.083848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:07.085675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 319/607] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:07.090474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe8bf6-7b9a-4db1-ad34-e13f4ab56ed3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.117610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.166870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.225620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a5bc-6bb3-4041-8f9a-ddc92a3de1cb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.227841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe8bf6-7b9a-4db1-ad34-e13f4ab56ed3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.273451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a77f-6ce9-4788-be44-c2afdb49f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.274333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a77f-6ce9-4788-be44-c2afdb49f4cb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.274722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a77f-6ce9-4788-be44-c2afdb49f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.275246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a77f-6ce9-4788-be44-c2afdb49f4cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.277694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30b11d-b0cc-465b-bfb4-4499410f9667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.278745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30b11d-b0cc-465b-bfb4-4499410f9667 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.279293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30b11d-b0cc-465b-bfb4-4499410f9667 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.279804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30b11d-b0cc-465b-bfb4-4499410f9667 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.280694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30b11d-b0cc-465b-bfb4-4499410f9667 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:07.281195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30b11d-b0cc-465b-bfb4-4499410f9667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.283429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30b11d-b0cc-465b-bfb4-4499410f9667 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.284404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a77f-6ce9-4788-be44-c2afdb49f4cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.286296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740a77f-6ce9-4788-be44-c2afdb49f4cb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-e740a77f-6ce9-4788-be44-c2afdb49f4cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:07.300973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:07.301947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:07.302807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:07.302807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:07.302807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:07.302807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:07.302807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:07.302807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:07.302807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:07.302807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:07.302807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 289/608] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:07.307973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a77f-6ce9-4788-be44-c2afdb49f4cb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.313846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 320/609] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:07.320745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30b11d-b0cc-465b-bfb4-4499410f9667 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.437158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.455066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a77f-6ce9-4788-be44-c2afdb49f4cb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.476924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30b11d-b0cc-465b-bfb4-4499410f9667 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.497393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e356a16-4baf-4373-aef1-ac65078be128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.498017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e356a16-4baf-4373-aef1-ac65078be128 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.498360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e356a16-4baf-4373-aef1-ac65078be128 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.498639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e356a16-4baf-4373-aef1-ac65078be128 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.499524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e356a16-4baf-4373-aef1-ac65078be128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:07.499840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e356a16-4baf-4373-aef1-ac65078be128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.502117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e356a16-4baf-4373-aef1-ac65078be128 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.506366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.523519 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 290/610] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:07.531050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e356a16-4baf-4373-aef1-ac65078be128 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.541034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af841ae-0771-40b7-9934-4422ea1ea529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.542046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af841ae-0771-40b7-9934-4422ea1ea529 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.542520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af841ae-0771-40b7-9934-4422ea1ea529 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.543030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af841ae-0771-40b7-9934-4422ea1ea529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.572032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af841ae-0771-40b7-9934-4422ea1ea529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.573958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af841ae-0771-40b7-9934-4422ea1ea529 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0af841ae-0771-40b7-9934-4422ea1ea529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:07.601322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:07.602310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:07.603201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:07.603201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:07.603201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:07.609887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 321/611] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:07.611043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af841ae-0771-40b7-9934-4422ea1ea529 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.688141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e356a16-4baf-4373-aef1-ac65078be128 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.750684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f0eb2-bab5-4a07-b7e3-e76aca2b4785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.752097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0eb2-bab5-4a07-b7e3-e76aca2b4785 None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.752760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0eb2-bab5-4a07-b7e3-e76aca2b4785 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.753179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f0eb2-bab5-4a07-b7e3-e76aca2b4785 None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/a7a82c500de745c0b55df44b7f641706/roles/90c85626d318449cb55d5c2bc0b2e18d` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.780192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af841ae-0771-40b7-9934-4422ea1ea529 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:07.786069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0eb2-bab5-4a07-b7e3-e76aca2b4785 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=a7a82c500de745c0b55df44b7f641706, role_id=90c85626d318449cb55d5c2bc0b2e18d)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.787818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f0eb2-bab5-4a07-b7e3-e76aca2b4785 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.804030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.810922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 291/612] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:07 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/a7a82c500de745c0b55df44b7f641706/roles/90c85626d318449cb55d5c2bc0b2e18d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:07.812754 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53819381-825f-48dc-94b9-96a474a090d9 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.813348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53819381-825f-48dc-94b9-96a474a090d9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.813823 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53819381-825f-48dc-94b9-96a474a090d9 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.815789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 292/613] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:07.823627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088beb3-b0b3-4018-9405-64960649efd5 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.824271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088beb3-b0b3-4018-9405-64960649efd5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.824739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088beb3-b0b3-4018-9405-64960649efd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.836769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca23c7-a7a9-4bd7-a3d6-bc6db0187750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:07.837407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca23c7-a7a9-4bd7-a3d6-bc6db0187750 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:07.837694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca23c7-a7a9-4bd7-a3d6-bc6db0187750 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:07.838012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca23c7-a7a9-4bd7-a3d6-bc6db0187750 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:07.838750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca23c7-a7a9-4bd7-a3d6-bc6db0187750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:07.839151 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca23c7-a7a9-4bd7-a3d6-bc6db0187750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:07.841048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca23c7-a7a9-4bd7-a3d6-bc6db0187750 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:07.848031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-3088beb3-b0b3-4018-9405-64960649efd5 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:07.849752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3088beb3-b0b3-4018-9405-64960649efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:07.856746 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 322/614] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:07.864991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca23c7-a7a9-4bd7-a3d6-bc6db0187750 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:07.899498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:07.929163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 293/615] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:08.017454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca23c7-a7a9-4bd7-a3d6-bc6db0187750 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.057708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014830f-051c-4b33-970f-d66479de5264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.058326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014830f-051c-4b33-970f-d66479de5264 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.058670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014830f-051c-4b33-970f-d66479de5264 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.058960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014830f-051c-4b33-970f-d66479de5264 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.067284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014830f-051c-4b33-970f-d66479de5264 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.068784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014830f-051c-4b33-970f-d66479de5264 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d014830f-051c-4b33-970f-d66479de5264 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:08.080984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:08.081960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:08.082860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 323/616] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:08.087812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088beb3-b0b3-4018-9405-64960649efd5 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.229724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088beb3-b0b3-4018-9405-64960649efd5 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.269471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.280533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3620f-6b5b-4f37-bf5d-2500771531d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.281146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3620f-6b5b-4f37-bf5d-2500771531d8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.281432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3620f-6b5b-4f37-bf5d-2500771531d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.282239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3620f-6b5b-4f37-bf5d-2500771531d8 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.283014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3620f-6b5b-4f37-bf5d-2500771531d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:08.283330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3620f-6b5b-4f37-bf5d-2500771531d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.284762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3620f-6b5b-4f37-bf5d-2500771531d8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.311601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 294/617] 10.222.0.89 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:08.317122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014830f-051c-4b33-970f-d66479de5264 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.347988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3620f-6b5b-4f37-bf5d-2500771531d8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.465273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3620f-6b5b-4f37-bf5d-2500771531d8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.512580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.533021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85082749-a588-41e2-b681-86b12d699b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.534063 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85082749-a588-41e2-b681-86b12d699b8d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.535228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85082749-a588-41e2-b681-86b12d699b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.535709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85082749-a588-41e2-b681-86b12d699b8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.538506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014830f-051c-4b33-970f-d66479de5264 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.560374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85082749-a588-41e2-b681-86b12d699b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-85082749-a588-41e2-b681-86b12d699b8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:08.565700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:08.566665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:08.567514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:08.571672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 295/618] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:08.579149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85082749-a588-41e2-b681-86b12d699b8d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.623956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e7f5a-7e30-42e9-b7ef-e8aedcb59a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.625213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e7f5a-7e30-42e9-b7ef-e8aedcb59a09 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.626965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e7f5a-7e30-42e9-b7ef-e8aedcb59a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.627621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e7f5a-7e30-42e9-b7ef-e8aedcb59a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.655902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e7f5a-7e30-42e9-b7ef-e8aedcb59a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.657746 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e7f5a-7e30-42e9-b7ef-e8aedcb59a09 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.675408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-cd6e7f5a-7e30-42e9-b7ef-e8aedcb59a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:08.684322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:08.685423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:08.686525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:08.686525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:08.686525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:08.695398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 324/619] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:08.701645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e7f5a-7e30-42e9-b7ef-e8aedcb59a09 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.771786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85082749-a588-41e2-b681-86b12d699b8d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.842762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25b868-ff6f-4860-b42d-3072ff94a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:08.843641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25b868-ff6f-4860-b42d-3072ff94a380 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:08.844769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25b868-ff6f-4860-b42d-3072ff94a380 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:08.845269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25b868-ff6f-4860-b42d-3072ff94a380 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:08.846149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25b868-ff6f-4860-b42d-3072ff94a380 None admin] RBAC: Adding query filter params (name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:08.846658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25b868-ff6f-4860-b42d-3072ff94a380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:08.848285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25b868-ff6f-4860-b42d-3072ff94a380 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:08.862872 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 296/620] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:08.864680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25b868-ff6f-4860-b42d-3072ff94a380 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:08.905633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e7f5a-7e30-42e9-b7ef-e8aedcb59a09 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.983939 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25b868-ff6f-4860-b42d-3072ff94a380 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:08.996298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.000261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0b881-e88a-472e-b997-9181a967d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.000950 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0b881-e88a-472e-b997-9181a967d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.001231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0b881-e88a-472e-b997-9181a967d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.001493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0b881-e88a-472e-b997-9181a967d9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.002152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0b881-e88a-472e-b997-9181a967d9b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:09.002454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0b881-e88a-472e-b997-9181a967d9b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.003998 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0b881-e88a-472e-b997-9181a967d9b4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.022464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.030436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 325/621] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:09.035160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcef57-7124-4f26-91b2-82d92605cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.036191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcef57-7124-4f26-91b2-82d92605cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.036455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0b881-e88a-472e-b997-9181a967d9b4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.037088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcef57-7124-4f26-91b2-82d92605cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.037570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcef57-7124-4f26-91b2-82d92605cfe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.050989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcef57-7124-4f26-91b2-82d92605cfe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.054067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcef57-7124-4f26-91b2-82d92605cfe5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-4dfcef57-7124-4f26-91b2-82d92605cfe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:09.077893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:09.079548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:09.080437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:09.080437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:09.080437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:09.089024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 297/622] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:09.095783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcef57-7124-4f26-91b2-82d92605cfe5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.225222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0b881-e88a-472e-b997-9181a967d9b4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.268278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54c635-b957-45de-bee0-f53641acbeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.269325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54c635-b957-45de-bee0-f53641acbeda None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.269956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54c635-b957-45de-bee0-f53641acbeda None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.270453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54c635-b957-45de-bee0-f53641acbeda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.288383 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54c635-b957-45de-bee0-f53641acbeda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.291355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54c635-b957-45de-bee0-f53641acbeda None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1b54c635-b957-45de-bee0-f53641acbeda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:09.303846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:09.304813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:09.306125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:09.306125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:09.306125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:09.306125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:09.306125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:09.306125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:09.306125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:09.306125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:09.306125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 326/623] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:09.306632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8c8ad-dfc4-4643-bae4-2b8ee19b0592 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.306918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8c8ad-dfc4-4643-bae4-2b8ee19b0592 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.311202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8c8ad-dfc4-4643-bae4-2b8ee19b0592 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.312874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 327/624] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:09.314516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8c8ad-dfc4-4643-bae4-2b8ee19b0592 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.318051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcef57-7124-4f26-91b2-82d92605cfe5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.367379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f86e05-3242-4633-a845-0a655ae11958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.368377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86e05-3242-4633-a845-0a655ae11958 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.368992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86e05-3242-4633-a845-0a655ae11958 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.369428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86e05-3242-4633-a845-0a655ae11958 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.370237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f86e05-3242-4633-a845-0a655ae11958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:09.370703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f86e05-3242-4633-a845-0a655ae11958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.372455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f86e05-3242-4633-a845-0a655ae11958 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.391934 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 298/625] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:09.394110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5c405-ed57-40b5-892f-f23601ac19b6 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.394395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5c405-ed57-40b5-892f-f23601ac19b6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.394669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5c405-ed57-40b5-892f-f23601ac19b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.397760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.416251 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-41e5c405-ed57-40b5-892f-f23601ac19b6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:09.417761 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-41e5c405-ed57-40b5-892f-f23601ac19b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:09.434322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.456185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8c8ad-dfc4-4643-bae4-2b8ee19b0592 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.498161 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 299/626] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:09.499399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5c405-ed57-40b5-892f-f23601ac19b6 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.505213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab88295-56d0-4394-9098-1555a2f42dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.506175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab88295-56d0-4394-9098-1555a2f42dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.506665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab88295-56d0-4394-9098-1555a2f42dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.508075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab88295-56d0-4394-9098-1555a2f42dd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.513179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab88295-56d0-4394-9098-1555a2f42dd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:09.513791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab88295-56d0-4394-9098-1555a2f42dd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.517008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab88295-56d0-4394-9098-1555a2f42dd4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.553627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 328/627] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:09.555847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab88295-56d0-4394-9098-1555a2f42dd4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.698313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5c405-ed57-40b5-892f-f23601ac19b6 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.709518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab88295-56d0-4394-9098-1555a2f42dd4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.735565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.752410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf334da2-f2e2-4546-ba89-01db3b17315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.753149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf334da2-f2e2-4546-ba89-01db3b17315d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.753650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf334da2-f2e2-4546-ba89-01db3b17315d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.754153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf334da2-f2e2-4546-ba89-01db3b17315d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.757303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04857170-736a-4d7c-9c4c-7cb8be51b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.758162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857170-736a-4d7c-9c4c-7cb8be51b931 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.759330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857170-736a-4d7c-9c4c-7cb8be51b931 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.759781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857170-736a-4d7c-9c4c-7cb8be51b931 None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/9df361aabe544b618c7c1c1d98b8751a/roles/90c85626d318449cb55d5c2bc0b2e18d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.769739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf334da2-f2e2-4546-ba89-01db3b17315d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.772387 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf334da2-f2e2-4546-ba89-01db3b17315d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.781452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04857170-736a-4d7c-9c4c-7cb8be51b931 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=9df361aabe544b618c7c1c1d98b8751a, role_id=90c85626d318449cb55d5c2bc0b2e18d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:09.783795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04857170-736a-4d7c-9c4c-7cb8be51b931 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-cf334da2-f2e2-4546-ba89-01db3b17315d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:09.786449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:09.787612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 300/628] 10.222.0.89 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f3d7-3fb0-4b4f-9b32-3dc8bce39782 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.793564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f3d7-3fb0-4b4f-9b32-3dc8bce39782 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.794435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f3d7-3fb0-4b4f-9b32-3dc8bce39782 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.794435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 301/629] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:09.794435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43f3d7-3fb0-4b4f-9b32-3dc8bce39782 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.808270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:09.811168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 329/630] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:09 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/9df361aabe544b618c7c1c1d98b8751a/roles/90c85626d318449cb55d5c2bc0b2e18d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:09.816688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdbf8b-8afa-472e-99b8-6b216b28554c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.817317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdbf8b-8afa-472e-99b8-6b216b28554c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.817782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdbf8b-8afa-472e-99b8-6b216b28554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.839886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-87cdbf8b-8afa-472e-99b8-6b216b28554c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:09.841644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-87cdbf8b-8afa-472e-99b8-6b216b28554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:09.919631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43f3d7-3fb0-4b4f-9b32-3dc8bce39782 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:09.933324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 330/631] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:09.934679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdbf8b-8afa-472e-99b8-6b216b28554c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:09.980760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb3cd0-cb14-48b4-8715-ef5aa71803f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:09.981330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb3cd0-cb14-48b4-8715-ef5aa71803f4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:09.981619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb3cd0-cb14-48b4-8715-ef5aa71803f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:09.981892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb3cd0-cb14-48b4-8715-ef5aa71803f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:09.993903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb3cd0-cb14-48b4-8715-ef5aa71803f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-25cb3cd0-cb14-48b4-8715-ef5aa71803f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:09.999584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:10.000742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:10.002705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 302/632] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:10.007085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb3cd0-cb14-48b4-8715-ef5aa71803f4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.057983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.065361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdbf8b-8afa-472e-99b8-6b216b28554c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.085645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.107843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935430f9-31a0-4227-aad6-9f081983deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.108644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935430f9-31a0-4227-aad6-9f081983deaa None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.109020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935430f9-31a0-4227-aad6-9f081983deaa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.109463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935430f9-31a0-4227-aad6-9f081983deaa None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.110908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935430f9-31a0-4227-aad6-9f081983deaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:10.111366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935430f9-31a0-4227-aad6-9f081983deaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.112929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935430f9-31a0-4227-aad6-9f081983deaa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.123899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb3cd0-cb14-48b4-8715-ef5aa71803f4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.134329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 331/633] 10.222.0.89 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:10.135733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82d00e-aa0a-4b35-9b5b-c82da540cfa7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.136029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82d00e-aa0a-4b35-9b5b-c82da540cfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.136308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82d00e-aa0a-4b35-9b5b-c82da540cfa7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.137843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 332/634] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:10.143270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82d00e-aa0a-4b35-9b5b-c82da540cfa7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.163314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439f9f6-fb42-4cb4-b762-14c657f7f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.164215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f9f6-fb42-4cb4-b762-14c657f7f47f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.164671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f9f6-fb42-4cb4-b762-14c657f7f47f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.165109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439f9f6-fb42-4cb4-b762-14c657f7f47f None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.165976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f9f6-fb42-4cb4-b762-14c657f7f47f None admin] RBAC: Adding query filter params (name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:10.166426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f9f6-fb42-4cb4-b762-14c657f7f47f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.168200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439f9f6-fb42-4cb4-b762-14c657f7f47f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.177969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 303/635] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:10.179493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb768c7c-40f8-40bb-9a49-909834ccba44 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.184374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb768c7c-40f8-40bb-9a49-909834ccba44 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.184374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb768c7c-40f8-40bb-9a49-909834ccba44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.211445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-bb768c7c-40f8-40bb-9a49-909834ccba44 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:10.213198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bb768c7c-40f8-40bb-9a49-909834ccba44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:10.268795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82d00e-aa0a-4b35-9b5b-c82da540cfa7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.293305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 304/636] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:10.294616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb768c7c-40f8-40bb-9a49-909834ccba44 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.310361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7461c0-f317-4531-b6f1-8ebc82a31be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.311058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7461c0-f317-4531-b6f1-8ebc82a31be8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.311333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7461c0-f317-4531-b6f1-8ebc82a31be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.311656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7461c0-f317-4531-b6f1-8ebc82a31be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.343262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.382626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.400251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7461c0-f317-4531-b6f1-8ebc82a31be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.401918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7461c0-f317-4531-b6f1-8ebc82a31be8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.434671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb768c7c-40f8-40bb-9a49-909834ccba44 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.480184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e64105-a7cb-4d67-89ca-7a9902073f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.480875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e64105-a7cb-4d67-89ca-7a9902073f5e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.481182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e64105-a7cb-4d67-89ca-7a9902073f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.481453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e64105-a7cb-4d67-89ca-7a9902073f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.494875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e64105-a7cb-4d67-89ca-7a9902073f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.496827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e64105-a7cb-4d67-89ca-7a9902073f5e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-24e64105-a7cb-4d67-89ca-7a9902073f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:10.516526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:10.517570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:10.518491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:10.518491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:10.518491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:10.518491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 305/637] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:10.518491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e64105-a7cb-4d67-89ca-7a9902073f5e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.535857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 333/638] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:10.537070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7461c0-f317-4531-b6f1-8ebc82a31be8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.599908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.649394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7461c0-f317-4531-b6f1-8ebc82a31be8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.650775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e64105-a7cb-4d67-89ca-7a9902073f5e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.665621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.686924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9214-a6b6-4a2b-a246-b3520cf824c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.688432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9214-a6b6-4a2b-a246-b3520cf824c8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.688744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9214-a6b6-4a2b-a246-b3520cf824c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.688971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43d771-778f-436b-80f0-d1476d4e6f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.689087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9214-a6b6-4a2b-a246-b3520cf824c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.689569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43d771-778f-436b-80f0-d1476d4e6f5f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.689847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43d771-778f-436b-80f0-d1476d4e6f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.690114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43d771-778f-436b-80f0-d1476d4e6f5f None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.690753 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43d771-778f-436b-80f0-d1476d4e6f5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:10.691088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43d771-778f-436b-80f0-d1476d4e6f5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.692463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43d771-778f-436b-80f0-d1476d4e6f5f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.700104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c9214-a6b6-4a2b-a246-b3520cf824c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:10.709416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 334/639] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:10.709416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43d771-778f-436b-80f0-d1476d4e6f5f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-790c9214-a6b6-4a2b-a246-b3520cf824c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:10.709750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:10.710674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 306/640] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:10.711571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9214-a6b6-4a2b-a246-b3520cf824c8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.826982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9214-a6b6-4a2b-a246-b3520cf824c8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.827207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43d771-778f-436b-80f0-d1476d4e6f5f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:10.846974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:10.864106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96f34c-216a-4653-abdc-9f05a64312da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.864736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96f34c-216a-4653-abdc-9f05a64312da None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.865014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96f34c-216a-4653-abdc-9f05a64312da None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.865289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96f34c-216a-4653-abdc-9f05a64312da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.868990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e9f8a-0fbc-48e5-87f4-90693f42ee2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:10.869736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e9f8a-0fbc-48e5-87f4-90693f42ee2d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:10.870080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e9f8a-0fbc-48e5-87f4-90693f42ee2d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:10.870474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e9f8a-0fbc-48e5-87f4-90693f42ee2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:10.875650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96f34c-216a-4653-abdc-9f05a64312da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-5b96f34c-216a-4653-abdc-9f05a64312da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:10.880764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:10.881690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:10.882633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:10.886545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e9f8a-0fbc-48e5-87f4-90693f42ee2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:10.886658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 307/641] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:10.887514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96f34c-216a-4653-abdc-9f05a64312da None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.888516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e9f8a-0fbc-48e5-87f4-90693f42ee2d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0f6e9f8a-0fbc-48e5-87f4-90693f42ee2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:10.908851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:10.909951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:10.910913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:10.910913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:10.910913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:10.915554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 335/642] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:10.916641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e9f8a-0fbc-48e5-87f4-90693f42ee2d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:10.927256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.000818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96f34c-216a-4653-abdc-9f05a64312da None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.035353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e9f8a-0fbc-48e5-87f4-90693f42ee2d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.039896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461a212-b23b-40c3-968a-d9832ea7f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.040619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461a212-b23b-40c3-968a-d9832ea7f90c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.040909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461a212-b23b-40c3-968a-d9832ea7f90c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.041181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461a212-b23b-40c3-968a-d9832ea7f90c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.049353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461a212-b23b-40c3-968a-d9832ea7f90c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.051026 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461a212-b23b-40c3-968a-d9832ea7f90c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-5461a212-b23b-40c3-968a-d9832ea7f90c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:11.063409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:11.064504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 308/643] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:11.065658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461a212-b23b-40c3-968a-d9832ea7f90c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.080668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3db51-190f-48b7-b0a9-5443e8fe0d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.081385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3db51-190f-48b7-b0a9-5443e8fe0d91 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.081597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3db51-190f-48b7-b0a9-5443e8fe0d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.081894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3db51-190f-48b7-b0a9-5443e8fe0d91 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.082591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3db51-190f-48b7-b0a9-5443e8fe0d91 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:11.082896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3db51-190f-48b7-b0a9-5443e8fe0d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.084378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3db51-190f-48b7-b0a9-5443e8fe0d91 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.093745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 336/644] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:11.095200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3db51-190f-48b7-b0a9-5443e8fe0d91 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.131485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.175185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.185612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461a212-b23b-40c3-968a-d9832ea7f90c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.223385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b501c-6032-447b-9091-641951fa279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.223987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b501c-6032-447b-9091-641951fa279f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.224266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b501c-6032-447b-9091-641951fa279f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.224528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b501c-6032-447b-9091-641951fa279f None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.225190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b501c-6032-447b-9091-641951fa279f None admin] RBAC: Adding query filter params (name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:11.225538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b501c-6032-447b-9091-641951fa279f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.225651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3db51-190f-48b7-b0a9-5443e8fe0d91 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.226851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b501c-6032-447b-9091-641951fa279f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.240243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 309/645] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:11.240243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b501c-6032-447b-9091-641951fa279f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.279366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fba86-a205-4573-91b4-b9b1f834b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.279975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fba86-a205-4573-91b4-b9b1f834b52f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.280308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fba86-a205-4573-91b4-b9b1f834b52f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.280591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fba86-a205-4573-91b4-b9b1f834b52f None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.281234 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fba86-a205-4573-91b4-b9b1f834b52f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:11.281556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fba86-a205-4573-91b4-b9b1f834b52f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.282918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fba86-a205-4573-91b4-b9b1f834b52f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.307088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 337/646] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:11.307088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fba86-a205-4573-91b4-b9b1f834b52f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.353750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b501c-6032-447b-9091-641951fa279f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.393188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6c93b-156d-4642-99e7-e3585105b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.394010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6c93b-156d-4642-99e7-e3585105b53a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.394396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6c93b-156d-4642-99e7-e3585105b53a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.394814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6c93b-156d-4642-99e7-e3585105b53a None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.395814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6c93b-156d-4642-99e7-e3585105b53a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:11.396246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6c93b-156d-4642-99e7-e3585105b53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.398156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6c93b-156d-4642-99e7-e3585105b53a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.418918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.419712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 310/647] 10.222.0.89 () {56 vars in 1137 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:11.420618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6c93b-156d-4642-99e7-e3585105b53a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.437294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fba86-a205-4573-91b4-b9b1f834b52f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.438539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.481328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5ea9-ceec-458b-a36f-0fbb6b9d45c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.482439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5ea9-ceec-458b-a36f-0fbb6b9d45c5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.483064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5ea9-ceec-458b-a36f-0fbb6b9d45c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.483931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5ea9-ceec-458b-a36f-0fbb6b9d45c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.498071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c5ea9-ceec-458b-a36f-0fbb6b9d45c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.499657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c5ea9-ceec-458b-a36f-0fbb6b9d45c5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ee3c5ea9-ceec-458b-a36f-0fbb6b9d45c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:11.516629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:11.517725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:11.519469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:11.519469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:11.519469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:11.519469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 338/648] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:11.519469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5ea9-ceec-458b-a36f-0fbb6b9d45c5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.549538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6c93b-156d-4642-99e7-e3585105b53a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.590857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fc5a1-e31e-4c3a-8e31-be8812f969f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.591560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc5a1-e31e-4c3a-8e31-be8812f969f7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.591883 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc5a1-e31e-4c3a-8e31-be8812f969f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.592192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc5a1-e31e-4c3a-8e31-be8812f969f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.605522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fc5a1-e31e-4c3a-8e31-be8812f969f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.607166 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fc5a1-e31e-4c3a-8e31-be8812f969f7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-4a6fc5a1-e31e-4c3a-8e31-be8812f969f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:11.626118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:11.627377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:11.628272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:11.628272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:11.628272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:11.628272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 311/649] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:11.628787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fc5a1-e31e-4c3a-8e31-be8812f969f7 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.645147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5ea9-ceec-458b-a36f-0fbb6b9d45c5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.689366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db47c-11af-42d2-a08e-233dbec78087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.690431 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db47c-11af-42d2-a08e-233dbec78087 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.690700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db47c-11af-42d2-a08e-233dbec78087 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.691100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84db47c-11af-42d2-a08e-233dbec78087 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.698723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84db47c-11af-42d2-a08e-233dbec78087 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.700578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84db47c-11af-42d2-a08e-233dbec78087 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d84db47c-11af-42d2-a08e-233dbec78087 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:11.713154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:11.714114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:11.715031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:11.715031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:11.715031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:11.715031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:11.715031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:11.715031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:11.715031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:11.715031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:11.715031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 339/650] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:11.715525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db47c-11af-42d2-a08e-233dbec78087 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.716724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.720326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.763561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fc5a1-e31e-4c3a-8e31-be8812f969f7 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.816122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45ce8-a532-44c0-a9bf-8b3392ba9653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.817049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45ce8-a532-44c0-a9bf-8b3392ba9653 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.817300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45ce8-a532-44c0-a9bf-8b3392ba9653 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.817572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45ce8-a532-44c0-a9bf-8b3392ba9653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.839800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84db47c-11af-42d2-a08e-233dbec78087 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:11.879640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a5b5-7579-4920-a6f9-fefcd63811d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:11.880175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a5b5-7579-4920-a6f9-fefcd63811d5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:11.880457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a5b5-7579-4920-a6f9-fefcd63811d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:11.880750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08a5b5-7579-4920-a6f9-fefcd63811d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:11.881393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08a5b5-7579-4920-a6f9-fefcd63811d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:11.882008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08a5b5-7579-4920-a6f9-fefcd63811d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.883098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08a5b5-7579-4920-a6f9-fefcd63811d5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.896616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 340/651] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:11.897249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d45ce8-a532-44c0-a9bf-8b3392ba9653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:11.897413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a5b5-7579-4920-a6f9-fefcd63811d5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:11.899167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d45ce8-a532-44c0-a9bf-8b3392ba9653 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:11.969837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:11.975328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.009940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 312/652] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:12.010840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45ce8-a532-44c0-a9bf-8b3392ba9653 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.014957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08a5b5-7579-4920-a6f9-fefcd63811d5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.049889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78634166-97d1-48b1-8a36-d22927fbc947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.050655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78634166-97d1-48b1-8a36-d22927fbc947 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.050851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78634166-97d1-48b1-8a36-d22927fbc947 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.051159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78634166-97d1-48b1-8a36-d22927fbc947 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.051917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78634166-97d1-48b1-8a36-d22927fbc947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.052221 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78634166-97d1-48b1-8a36-d22927fbc947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.053724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78634166-97d1-48b1-8a36-d22927fbc947 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.066058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 341/653] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.071281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78634166-97d1-48b1-8a36-d22927fbc947 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.128367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45ce8-a532-44c0-a9bf-8b3392ba9653 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.166845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b8df0-527d-438f-a6be-c933c5fe9c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.167370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8df0-527d-438f-a6be-c933c5fe9c2f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.167652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8df0-527d-438f-a6be-c933c5fe9c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.167930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8df0-527d-438f-a6be-c933c5fe9c2f None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.168629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b8df0-527d-438f-a6be-c933c5fe9c2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.168930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b8df0-527d-438f-a6be-c933c5fe9c2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.170359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b8df0-527d-438f-a6be-c933c5fe9c2f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.182571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 313/654] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.183898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3363b23-4408-4b16-9b6a-2736cbf9c316 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.184187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3363b23-4408-4b16-9b6a-2736cbf9c316 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.184461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3363b23-4408-4b16-9b6a-2736cbf9c316 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.185809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 314/655] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:12.186975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78634166-97d1-48b1-8a36-d22927fbc947 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.188733 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3363b23-4408-4b16-9b6a-2736cbf9c316 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.214199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.219793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.227245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672e7c-8c69-4554-9391-8cf395fe6f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.228034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672e7c-8c69-4554-9391-8cf395fe6f47 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.228358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672e7c-8c69-4554-9391-8cf395fe6f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.228664 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672e7c-8c69-4554-9391-8cf395fe6f47 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.237582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c672e7c-8c69-4554-9391-8cf395fe6f47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.239363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c672e7c-8c69-4554-9391-8cf395fe6f47 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8c672e7c-8c69-4554-9391-8cf395fe6f47 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:12.253966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:12.255057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 342/656] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:12.256446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672e7c-8c69-4554-9391-8cf395fe6f47 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.303620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3363b23-4408-4b16-9b6a-2736cbf9c316 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.340847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1025b-1a0f-47e1-99b0-fb148f3a005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.341470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1025b-1a0f-47e1-99b0-fb148f3a005b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.341746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1025b-1a0f-47e1-99b0-fb148f3a005b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.342016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1025b-1a0f-47e1-99b0-fb148f3a005b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.353613 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1025b-1a0f-47e1-99b0-fb148f3a005b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.355107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1025b-1a0f-47e1-99b0-fb148f3a005b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.363015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672e7c-8c69-4554-9391-8cf395fe6f47 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-8cc1025b-1a0f-47e1-99b0-fb148f3a005b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:12.370062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:12.376238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:12.377391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:12.377391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:12.377391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:12.377391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 315/657] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:12.377391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1025b-1a0f-47e1-99b0-fb148f3a005b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.399346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff915-fab8-4e28-bb81-ebe36e51546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.399971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff915-fab8-4e28-bb81-ebe36e51546b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.400247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff915-fab8-4e28-bb81-ebe36e51546b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.400510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff915-fab8-4e28-bb81-ebe36e51546b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.407952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfff915-fab8-4e28-bb81-ebe36e51546b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.409370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfff915-fab8-4e28-bb81-ebe36e51546b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2bfff915-fab8-4e28-bb81-ebe36e51546b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:12.424232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:12.425437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:12.426537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 343/658] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:12.427267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f904df9-ffdf-4e23-9f31-568067a12b86 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.427267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f904df9-ffdf-4e23-9f31-568067a12b86 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.427267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f904df9-ffdf-4e23-9f31-568067a12b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.445577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0f904df9-ffdf-4e23-9f31-568067a12b86 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:12.446790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0f904df9-ffdf-4e23-9f31-568067a12b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:12.463220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.488481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1025b-1a0f-47e1-99b0-fb148f3a005b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.499068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.524123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf1557-9e85-4cc6-9dd7-ea30bc85c7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.524734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf1557-9e85-4cc6-9dd7-ea30bc85c7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.525016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf1557-9e85-4cc6-9dd7-ea30bc85c7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.525293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf1557-9e85-4cc6-9dd7-ea30bc85c7c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.526026 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf1557-9e85-4cc6-9dd7-ea30bc85c7c0 None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=5cbda75c38b04e6c89f17e655eb4f737) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.526338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf1557-9e85-4cc6-9dd7-ea30bc85c7c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.527825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf1557-9e85-4cc6-9dd7-ea30bc85c7c0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.529733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 344/659] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:12.530773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f904df9-ffdf-4e23-9f31-568067a12b86 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.533918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 316/660] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/role_assignments?user.id=5cbda75c38b04e6c89f17e655eb4f737&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.534723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf1557-9e85-4cc6-9dd7-ea30bc85c7c0 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.661218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f904df9-ffdf-4e23-9f31-568067a12b86 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.688250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf1557-9e85-4cc6-9dd7-ea30bc85c7c0 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.709284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5113b-0635-47ac-a726-673bf1becf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.710983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5113b-0635-47ac-a726-673bf1becf65 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.710983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5113b-0635-47ac-a726-673bf1becf65 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.711218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5113b-0635-47ac-a726-673bf1becf65 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.712033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5113b-0635-47ac-a726-673bf1becf65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.712517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5113b-0635-47ac-a726-673bf1becf65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.714381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5113b-0635-47ac-a726-673bf1becf65 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.732061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5af9be-6039-4cce-8269-d7c1c58c54fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.733190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5af9be-6039-4cce-8269-d7c1c58c54fe None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.733529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5af9be-6039-4cce-8269-d7c1c58c54fe None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.733914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5af9be-6039-4cce-8269-d7c1c58c54fe None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.734639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5af9be-6039-4cce-8269-d7c1c58c54fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.736271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5af9be-6039-4cce-8269-d7c1c58c54fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.736774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5af9be-6039-4cce-8269-d7c1c58c54fe None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.745663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 345/661] 10.222.0.89 () {56 vars in 1137 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.745663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5113b-0635-47ac-a726-673bf1becf65 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.751131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 317/662] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.753117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5af9be-6039-4cce-8269-d7c1c58c54fe None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:12.756104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.791578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:12.880771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5af9be-6039-4cce-8269-d7c1c58c54fe None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.888856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5113b-0635-47ac-a726-673bf1becf65 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:12.921618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c6263-5c9c-4df8-9563-d4d899d1da40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.922665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6263-5c9c-4df8-9563-d4d899d1da40 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.923434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6263-5c9c-4df8-9563-d4d899d1da40 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.923859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c6263-5c9c-4df8-9563-d4d899d1da40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.932939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c755e47-536e-4940-b432-9684a4a46633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:12.933697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c755e47-536e-4940-b432-9684a4a46633 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:12.933981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c755e47-536e-4940-b432-9684a4a46633 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:12.934459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c755e47-536e-4940-b432-9684a4a46633 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:12.935315 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c755e47-536e-4940-b432-9684a4a46633 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:12.935626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c755e47-536e-4940-b432-9684a4a46633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:12.937058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c755e47-536e-4940-b432-9684a4a46633 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:12.955633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 346/663] 10.222.0.89 () {56 vars in 1139 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:12.956391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c755e47-536e-4940-b432-9684a4a46633 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.018833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c6263-5c9c-4df8-9563-d4d899d1da40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.020481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c6263-5c9c-4df8-9563-d4d899d1da40 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.022792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.073172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.085748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c755e47-536e-4940-b432-9684a4a46633 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.135176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978c071-b00b-4afb-a50b-432c2749243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.135813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978c071-b00b-4afb-a50b-432c2749243e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.136099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978c071-b00b-4afb-a50b-432c2749243e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.136366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978c071-b00b-4afb-a50b-432c2749243e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.143697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978c071-b00b-4afb-a50b-432c2749243e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.145138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978c071-b00b-4afb-a50b-432c2749243e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.156126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 318/664] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1978c071-b00b-4afb-a50b-432c2749243e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:13.157213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:13.158153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 347/665] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:13.159164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978c071-b00b-4afb-a50b-432c2749243e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.160192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c6263-5c9c-4df8-9563-d4d899d1da40 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.261996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978c071-b00b-4afb-a50b-432c2749243e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.275097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c6263-5c9c-4df8-9563-d4d899d1da40 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.276871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.299606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2531be-8dae-4cb6-b05d-c075001ff630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.300279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2531be-8dae-4cb6-b05d-c075001ff630 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.300585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2531be-8dae-4cb6-b05d-c075001ff630 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.300888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2531be-8dae-4cb6-b05d-c075001ff630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.315308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbe356-e02a-4c55-85b7-8baf3f65d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.315948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbe356-e02a-4c55-85b7-8baf3f65d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.316234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbe356-e02a-4c55-85b7-8baf3f65d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.316511 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbe356-e02a-4c55-85b7-8baf3f65d6b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.324356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.336593 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbe356-e02a-4c55-85b7-8baf3f65d6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-34fbe356-e02a-4c55-85b7-8baf3f65d6b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:13.341356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:13.342282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:13.343170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 319/666] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:13.344959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbe356-e02a-4c55-85b7-8baf3f65d6b3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.390579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2531be-8dae-4cb6-b05d-c075001ff630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.392164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2531be-8dae-4cb6-b05d-c075001ff630 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.458805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbe356-e02a-4c55-85b7-8baf3f65d6b3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.495247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725afb-13a5-4cfe-bf53-f0f0fc2f1752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.495913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725afb-13a5-4cfe-bf53-f0f0fc2f1752 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.496153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725afb-13a5-4cfe-bf53-f0f0fc2f1752 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.496427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725afb-13a5-4cfe-bf53-f0f0fc2f1752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.497016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 348/667] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:13.497860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2531be-8dae-4cb6-b05d-c075001ff630 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.511911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725afb-13a5-4cfe-bf53-f0f0fc2f1752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.513434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725afb-13a5-4cfe-bf53-f0f0fc2f1752 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-84725afb-13a5-4cfe-bf53-f0f0fc2f1752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:13.529245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:13.530258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:13.531185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:13.531185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:13.531185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:13.531185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 320/668] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:13.531185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725afb-13a5-4cfe-bf53-f0f0fc2f1752 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.551945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.559638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.631025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2531be-8dae-4cb6-b05d-c075001ff630 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.639382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725afb-13a5-4cfe-bf53-f0f0fc2f1752 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.669600 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e76db3-5de4-47ad-a508-dbdb2241db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.670215 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e76db3-5de4-47ad-a508-dbdb2241db53 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.670494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e76db3-5de4-47ad-a508-dbdb2241db53 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.670799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e76db3-5de4-47ad-a508-dbdb2241db53 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.671501 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e76db3-5de4-47ad-a508-dbdb2241db53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:13.671862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e76db3-5de4-47ad-a508-dbdb2241db53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.673818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e76db3-5de4-47ad-a508-dbdb2241db53 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.686514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 349/669] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:13.687380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e76db3-5de4-47ad-a508-dbdb2241db53 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.694493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6e98b-038b-4e2e-95aa-27813618e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.696345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e98b-038b-4e2e-95aa-27813618e348 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.696735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e98b-038b-4e2e-95aa-27813618e348 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.697155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e98b-038b-4e2e-95aa-27813618e348 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.698166 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6e98b-038b-4e2e-95aa-27813618e348 None admin] RBAC: Adding query filter params (name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:13.698547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6e98b-038b-4e2e-95aa-27813618e348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.700256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6e98b-038b-4e2e-95aa-27813618e348 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.710976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 321/670] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:13.711806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6e98b-038b-4e2e-95aa-27813618e348 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.821520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e76db3-5de4-47ad-a508-dbdb2241db53 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.833687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.838147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:13.861718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d392a56-f778-4006-9250-810d0de77e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.862639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d392a56-f778-4006-9250-810d0de77e3f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.862919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d392a56-f778-4006-9250-810d0de77e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.863474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d392a56-f778-4006-9250-810d0de77e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.867911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6e98b-038b-4e2e-95aa-27813618e348 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:13.875567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d392a56-f778-4006-9250-810d0de77e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.877459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d392a56-f778-4006-9250-810d0de77e3f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-7d392a56-f778-4006-9250-810d0de77e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:13.899870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:13.901032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:13.902021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:13.902021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:13.902021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:13.902021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 350/671] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:13.902021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d392a56-f778-4006-9250-810d0de77e3f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:13.916276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4064a38-1487-4b02-97a7-81d47b78f573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:13.917194 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4064a38-1487-4b02-97a7-81d47b78f573 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:13.917735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4064a38-1487-4b02-97a7-81d47b78f573 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:13.918570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4064a38-1487-4b02-97a7-81d47b78f573 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:13.919579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4064a38-1487-4b02-97a7-81d47b78f573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:13.920147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4064a38-1487-4b02-97a7-81d47b78f573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:13.921891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4064a38-1487-4b02-97a7-81d47b78f573 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:13.935341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 322/672] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:13.936467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4064a38-1487-4b02-97a7-81d47b78f573 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.034046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d392a56-f778-4006-9250-810d0de77e3f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.069495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4064a38-1487-4b02-97a7-81d47b78f573 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.075219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ace3ad-47ea-4e5a-aefa-204c81b30ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.075825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ace3ad-47ea-4e5a-aefa-204c81b30ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.076100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ace3ad-47ea-4e5a-aefa-204c81b30ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.076367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ace3ad-47ea-4e5a-aefa-204c81b30ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.077088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ace3ad-47ea-4e5a-aefa-204c81b30ca0 None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=4a128a6b32fd4a54ad0146551fe77879) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.077391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ace3ad-47ea-4e5a-aefa-204c81b30ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.079384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ace3ad-47ea-4e5a-aefa-204c81b30ca0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.085619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 351/673] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/role_assignments?user.id=4a128a6b32fd4a54ad0146551fe77879&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:14.086425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ace3ad-47ea-4e5a-aefa-204c81b30ca0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.118859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.134414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a20ee4-60ff-40f7-8902-e1542165fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.136120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a20ee4-60ff-40f7-8902-e1542165fb87 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.136587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a20ee4-60ff-40f7-8902-e1542165fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.137017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a20ee4-60ff-40f7-8902-e1542165fb87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.152452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a20ee4-60ff-40f7-8902-e1542165fb87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.154366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a20ee4-60ff-40f7-8902-e1542165fb87 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.157686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-15a20ee4-60ff-40f7-8902-e1542165fb87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:14.176646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.177951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:14.179122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:14.179122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:14.179122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:14.186291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 323/674] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.186291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a20ee4-60ff-40f7-8902-e1542165fb87 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.242288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ace3ad-47ea-4e5a-aefa-204c81b30ca0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.299069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc1de-be99-4c69-8527-4c463bf358fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.299719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc1de-be99-4c69-8527-4c463bf358fb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.299957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc1de-be99-4c69-8527-4c463bf358fb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.300224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc1de-be99-4c69-8527-4c463bf358fb None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.301167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afc1de-be99-4c69-8527-4c463bf358fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.301504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afc1de-be99-4c69-8527-4c463bf358fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.303241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afc1de-be99-4c69-8527-4c463bf358fb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.323671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 352/675] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:14.327186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc1de-be99-4c69-8527-4c463bf358fb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.327400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a20ee4-60ff-40f7-8902-e1542165fb87 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.368786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c308f8e-36d6-490a-bf9c-8a58730857bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.369422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c308f8e-36d6-490a-bf9c-8a58730857bd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.369704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c308f8e-36d6-490a-bf9c-8a58730857bd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.369978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c308f8e-36d6-490a-bf9c-8a58730857bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.392642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c308f8e-36d6-490a-bf9c-8a58730857bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.394358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c308f8e-36d6-490a-bf9c-8a58730857bd None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-9c308f8e-36d6-490a-bf9c-8a58730857bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:14.411226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.412148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.413030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:14.413030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:14.413030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:14.413030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:14.413030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:14.413030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:14.413030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:14.413030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:14.419022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 324/676] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.421888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c308f8e-36d6-490a-bf9c-8a58730857bd None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.430862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.450000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc1de-be99-4c69-8527-4c463bf358fb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.488402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf9c75-763f-4811-b1d6-52134d7fed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.489012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf9c75-763f-4811-b1d6-52134d7fed01 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.489290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf9c75-763f-4811-b1d6-52134d7fed01 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.489561 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf9c75-763f-4811-b1d6-52134d7fed01 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.490200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf9c75-763f-4811-b1d6-52134d7fed01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.490504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf9c75-763f-4811-b1d6-52134d7fed01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.491896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf9c75-763f-4811-b1d6-52134d7fed01 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.492294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.504940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 353/677] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:14.505868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf9c75-763f-4811-b1d6-52134d7fed01 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.566053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c308f8e-36d6-490a-bf9c-8a58730857bd None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.607697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab53bf-fc3d-4043-9c3c-da8688479e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.608742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab53bf-fc3d-4043-9c3c-da8688479e22 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.609228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab53bf-fc3d-4043-9c3c-da8688479e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.609726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab53bf-fc3d-4043-9c3c-da8688479e22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.618059 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab53bf-fc3d-4043-9c3c-da8688479e22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.620426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab53bf-fc3d-4043-9c3c-da8688479e22 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-1fab53bf-fc3d-4043-9c3c-da8688479e22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:14.633863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.634821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.635756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:14.635756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:14.635756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:14.635756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:14.635756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:14.635756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:14.635756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:14.635756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:14.635756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 325/678] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.636254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab53bf-fc3d-4043-9c3c-da8688479e22 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.647443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf9c75-763f-4811-b1d6-52134d7fed01 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.687384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9f728-da29-4383-b867-672cafd0f4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.688026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9f728-da29-4383-b867-672cafd0f4ec None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.688313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9f728-da29-4383-b867-672cafd0f4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.688695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9f728-da29-4383-b867-672cafd0f4ec None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.689389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9f728-da29-4383-b867-672cafd0f4ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.689692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9f728-da29-4383-b867-672cafd0f4ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.691141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9f728-da29-4383-b867-672cafd0f4ec None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.708852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 354/679] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:14.708852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba601c-017d-403f-9a2a-4c031d2c8f4f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.708852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba601c-017d-403f-9a2a-4c031d2c8f4f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.708852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba601c-017d-403f-9a2a-4c031d2c8f4f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.708852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 355/680] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:14.708852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba601c-017d-403f-9a2a-4c031d2c8f4f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.718408 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.755493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab53bf-fc3d-4043-9c3c-da8688479e22 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.766526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.805860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c6416-9e61-4254-a9d1-93600784b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.806499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c6416-9e61-4254-a9d1-93600784b4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.806778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c6416-9e61-4254-a9d1-93600784b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.807080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c6416-9e61-4254-a9d1-93600784b4b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.815699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c6416-9e61-4254-a9d1-93600784b4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.817144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c6416-9e61-4254-a9d1-93600784b4b0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-cb5c6416-9e61-4254-a9d1-93600784b4b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:14.828835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:14.829989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:14.831159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:14.834749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 326/681] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:14.835666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c6416-9e61-4254-a9d1-93600784b4b0 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:14.843066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba601c-017d-403f-9a2a-4c031d2c8f4f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.883241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6735ec8-9add-4c13-9ddb-6fba315b572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.883772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6735ec8-9add-4c13-9ddb-6fba315b572c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.884122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6735ec8-9add-4c13-9ddb-6fba315b572c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.884311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6735ec8-9add-4c13-9ddb-6fba315b572c None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.885003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6735ec8-9add-4c13-9ddb-6fba315b572c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.885311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6735ec8-9add-4c13-9ddb-6fba315b572c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.886723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6735ec8-9add-4c13-9ddb-6fba315b572c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:14.903446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 356/682] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:14.903446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5168-4f60-4af8-b02e-24b98a126980 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.903446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5168-4f60-4af8-b02e-24b98a126980 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.903446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5168-4f60-4af8-b02e-24b98a126980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.919336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-652b5168-4f60-4af8-b02e-24b98a126980 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:14.920556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-652b5168-4f60-4af8-b02e-24b98a126980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:14.950502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c6416-9e61-4254-a9d1-93600784b4b0 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:14.987877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:14.993054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6887f-1f74-465c-864d-bd0757013653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:14.993653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6887f-1f74-465c-864d-bd0757013653 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:14.993938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6887f-1f74-465c-864d-bd0757013653 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:14.994210 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6887f-1f74-465c-864d-bd0757013653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:14.995041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6887f-1f74-465c-864d-bd0757013653 None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=4d055337c9a642bd9b8b5a60aacb11cd) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:14.995287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6887f-1f74-465c-864d-bd0757013653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:14.996728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6887f-1f74-465c-864d-bd0757013653 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.001342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 357/683] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:15.011228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5168-4f60-4af8-b02e-24b98a126980 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.016718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 327/684] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:14 2022] GET /identity/v3/role_assignments?user.id=4d055337c9a642bd9b8b5a60aacb11cd&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.018441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6887f-1f74-465c-864d-bd0757013653 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.126658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5168-4f60-4af8-b02e-24b98a126980 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.135417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.170149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f14825-104a-4666-b12d-b67c1bf8690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.170832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f14825-104a-4666-b12d-b67c1bf8690f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.171145 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f14825-104a-4666-b12d-b67c1bf8690f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.171415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f14825-104a-4666-b12d-b67c1bf8690f None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.172226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f14825-104a-4666-b12d-b67c1bf8690f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:15.172626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f14825-104a-4666-b12d-b67c1bf8690f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.174185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f14825-104a-4666-b12d-b67c1bf8690f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.198323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 358/685] 10.222.0.89 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.204945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f14825-104a-4666-b12d-b67c1bf8690f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.314464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.339630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f14825-104a-4666-b12d-b67c1bf8690f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.341821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6887f-1f74-465c-864d-bd0757013653 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.392228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf8634-fd8a-4fcd-9d0d-d0a53c1b7b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.393315 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf8634-fd8a-4fcd-9d0d-d0a53c1b7b5c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.394011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf8634-fd8a-4fcd-9d0d-d0a53c1b7b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.394377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf8634-fd8a-4fcd-9d0d-d0a53c1b7b5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.407631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1732bb-1ff7-492a-a61f-fe5d6333ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.409078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1732bb-1ff7-492a-a61f-fe5d6333ba27 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.409642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1732bb-1ff7-492a-a61f-fe5d6333ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.410145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1732bb-1ff7-492a-a61f-fe5d6333ba27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.411521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1732bb-1ff7-492a-a61f-fe5d6333ba27 None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=a7a82c500de745c0b55df44b7f641706) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:15.412382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1732bb-1ff7-492a-a61f-fe5d6333ba27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.414028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1732bb-1ff7-492a-a61f-fe5d6333ba27 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.422862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 328/686] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/role_assignments?user.id=a7a82c500de745c0b55df44b7f641706&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 608 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.424052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1732bb-1ff7-492a-a61f-fe5d6333ba27 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.527276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf8634-fd8a-4fcd-9d0d-d0a53c1b7b5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.528649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf8634-fd8a-4fcd-9d0d-d0a53c1b7b5c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.543131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.553113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1732bb-1ff7-492a-a61f-fe5d6333ba27 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.597357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de069a-daed-4efd-967a-9f4dab7eb89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.598869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de069a-daed-4efd-967a-9f4dab7eb89a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.599482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de069a-daed-4efd-967a-9f4dab7eb89a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.599982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de069a-daed-4efd-967a-9f4dab7eb89a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.615232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de069a-daed-4efd-967a-9f4dab7eb89a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-06de069a-daed-4efd-967a-9f4dab7eb89a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:15.621594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:15.622690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:15.623636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:15.627083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 329/687] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:15.633769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de069a-daed-4efd-967a-9f4dab7eb89a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.635546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.713769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 359/688] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:15.715118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf8634-fd8a-4fcd-9d0d-d0a53c1b7b5c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.800095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de069a-daed-4efd-967a-9f4dab7eb89a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.849432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39e1d7-0a02-4278-930a-8c24a31a532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.850132 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39e1d7-0a02-4278-930a-8c24a31a532f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.850473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39e1d7-0a02-4278-930a-8c24a31a532f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.850751 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39e1d7-0a02-4278-930a-8c24a31a532f None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.851466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39e1d7-0a02-4278-930a-8c24a31a532f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:15.851777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39e1d7-0a02-4278-930a-8c24a31a532f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.853284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39e1d7-0a02-4278-930a-8c24a31a532f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.857467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf8634-fd8a-4fcd-9d0d-d0a53c1b7b5c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:15.864246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 330/689] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:15.875608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39e1d7-0a02-4278-930a-8c24a31a532f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.901812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.905006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dabcd2-eb74-497d-9217-b6d2d0ba8c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:15.905727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dabcd2-eb74-497d-9217-b6d2d0ba8c4d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:15.906040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dabcd2-eb74-497d-9217-b6d2d0ba8c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:15.906852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dabcd2-eb74-497d-9217-b6d2d0ba8c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:15.917896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dabcd2-eb74-497d-9217-b6d2d0ba8c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:15.919423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dabcd2-eb74-497d-9217-b6d2d0ba8c4d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-57dabcd2-eb74-497d-9217-b6d2d0ba8c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:15.936800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:15.938018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:15.939018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:15.939018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:15.939018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:15.942057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 360/690] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:15.943110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dabcd2-eb74-497d-9217-b6d2d0ba8c4d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:15.954970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:15.996221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39e1d7-0a02-4278-930a-8c24a31a532f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.037966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367128-7a3f-4444-9c9c-47563b8404a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.038839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367128-7a3f-4444-9c9c-47563b8404a7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.039306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367128-7a3f-4444-9c9c-47563b8404a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.039885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367128-7a3f-4444-9c9c-47563b8404a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.051880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dabcd2-eb74-497d-9217-b6d2d0ba8c4d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.059883 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367128-7a3f-4444-9c9c-47563b8404a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.061541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367128-7a3f-4444-9c9c-47563b8404a7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-8c367128-7a3f-4444-9c9c-47563b8404a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:16.086441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:16.087679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:16.088695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:16.088695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:16.088695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:16.088859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a01a-2840-4a96-89b2-816da49e38d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.088859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a01a-2840-4a96-89b2-816da49e38d5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.088859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a01a-2840-4a96-89b2-816da49e38d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.088859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577a01a-2840-4a96-89b2-816da49e38d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.089134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577a01a-2840-4a96-89b2-816da49e38d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:16.089208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577a01a-2840-4a96-89b2-816da49e38d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.090562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577a01a-2840-4a96-89b2-816da49e38d5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.090925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 331/691] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:16.097473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367128-7a3f-4444-9c9c-47563b8404a7 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.112815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 361/692] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:16.114842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a01a-2840-4a96-89b2-816da49e38d5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.183408 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.215658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.220722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577a01a-2840-4a96-89b2-816da49e38d5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.256995 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de816d1-e9a2-420f-b2ae-535fded79ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.257852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de816d1-e9a2-420f-b2ae-535fded79ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.258275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de816d1-e9a2-420f-b2ae-535fded79ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.258691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de816d1-e9a2-420f-b2ae-535fded79ce5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.266848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367128-7a3f-4444-9c9c-47563b8404a7 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.267318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de816d1-e9a2-420f-b2ae-535fded79ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.269015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de816d1-e9a2-420f-b2ae-535fded79ce5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8de816d1-e9a2-420f-b2ae-535fded79ce5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:16.281473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:16.282565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:16.283683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:16.283683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:16.283683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:16.283683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:16.283683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:16.283683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:16.283683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:16.283683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:16.285734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 362/693] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:16.291782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f1e02-ee6f-421d-b4b5-e3b81271a047 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.292248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f1e02-ee6f-421d-b4b5-e3b81271a047 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.292794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f1e02-ee6f-421d-b4b5-e3b81271a047 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.294674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 363/694] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:16.295645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f1e02-ee6f-421d-b4b5-e3b81271a047 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.309410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074262a-9d90-426e-829c-6b49ff112da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.310173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074262a-9d90-426e-829c-6b49ff112da9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.310560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074262a-9d90-426e-829c-6b49ff112da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.311000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074262a-9d90-426e-829c-6b49ff112da9 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.311750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074262a-9d90-426e-829c-6b49ff112da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:16.312159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074262a-9d90-426e-829c-6b49ff112da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.314219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074262a-9d90-426e-829c-6b49ff112da9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.331135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 332/695] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:16.331135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a46b9-a670-400d-af1a-ed46ffc31961 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.331135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a46b9-a670-400d-af1a-ed46ffc31961 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.331135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a46b9-a670-400d-af1a-ed46ffc31961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.349438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-051a46b9-a670-400d-af1a-ed46ffc31961 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:16.354890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-051a46b9-a670-400d-af1a-ed46ffc31961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:16.435215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 333/696] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:16.436280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a46b9-a670-400d-af1a-ed46ffc31961 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.439829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f1e02-ee6f-421d-b4b5-e3b81271a047 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.471697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.484472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67528551-c5b6-4bdc-879b-a46ff6a74f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.486152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67528551-c5b6-4bdc-879b-a46ff6a74f24 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.486587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67528551-c5b6-4bdc-879b-a46ff6a74f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.489083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67528551-c5b6-4bdc-879b-a46ff6a74f24 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.490552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67528551-c5b6-4bdc-879b-a46ff6a74f24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:16.491211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67528551-c5b6-4bdc-879b-a46ff6a74f24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.494747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67528551-c5b6-4bdc-879b-a46ff6a74f24 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.520079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 364/697] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:16.525869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67528551-c5b6-4bdc-879b-a46ff6a74f24 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.544449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.607146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a46b9-a670-400d-af1a-ed46ffc31961 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.683656 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa6e6a-94bf-451d-8bd3-76e9fc3c55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.684307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa6e6a-94bf-451d-8bd3-76e9fc3c55d9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.684588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa6e6a-94bf-451d-8bd3-76e9fc3c55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.684884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa6e6a-94bf-451d-8bd3-76e9fc3c55d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.700005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa6e6a-94bf-451d-8bd3-76e9fc3c55d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.701449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa6e6a-94bf-451d-8bd3-76e9fc3c55d9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.703875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67528551-c5b6-4bdc-879b-a46ff6a74f24 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-14aa6e6a-94bf-451d-8bd3-76e9fc3c55d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:16.723526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:16.724636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:16.725762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:16.728320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 334/698] 10.222.0.89 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:16.734107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa6e6a-94bf-451d-8bd3-76e9fc3c55d9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.786976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1baa81-e579-457a-b9c5-83554863e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:16.787820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1baa81-e579-457a-b9c5-83554863e7dd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:16.788345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1baa81-e579-457a-b9c5-83554863e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:16.788830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1baa81-e579-457a-b9c5-83554863e7dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:16.789795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1baa81-e579-457a-b9c5-83554863e7dd None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=9df361aabe544b618c7c1c1d98b8751a) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:16.790315 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1baa81-e579-457a-b9c5-83554863e7dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:16.791999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1baa81-e579-457a-b9c5-83554863e7dd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:16.799411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 365/699] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/role_assignments?user.id=9df361aabe544b618c7c1c1d98b8751a&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:16.800760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1baa81-e579-457a-b9c5-83554863e7dd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:16.894019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.928628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa6e6a-94bf-451d-8bd3-76e9fc3c55d9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.970568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:16.990521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1baa81-e579-457a-b9c5-83554863e7dd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:16.999689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0797e-734b-469d-9e04-7a8b718e33bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.001491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0797e-734b-469d-9e04-7a8b718e33bc None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.001767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0797e-734b-469d-9e04-7a8b718e33bc None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.002096 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0797e-734b-469d-9e04-7a8b718e33bc None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.002861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0797e-734b-469d-9e04-7a8b718e33bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:17.003238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0797e-734b-469d-9e04-7a8b718e33bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.005195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0797e-734b-469d-9e04-7a8b718e33bc None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.039092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 335/700] 10.222.0.89 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:17.042305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0797e-734b-469d-9e04-7a8b718e33bc None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.046758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74da087-0b31-4df5-be47-6574eb2f669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.049441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74da087-0b31-4df5-be47-6574eb2f669b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.049441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74da087-0b31-4df5-be47-6574eb2f669b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.049441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74da087-0b31-4df5-be47-6574eb2f669b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.049441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74da087-0b31-4df5-be47-6574eb2f669b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.050555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74da087-0b31-4df5-be47-6574eb2f669b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b74da087-0b31-4df5-be47-6574eb2f669b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:17.069776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:17.071401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:17.072266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 366/701] 10.222.0.89 () {56 vars in 1129 bytes} [Fri Aug 26 15:27:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:17.079574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74da087-0b31-4df5-be47-6574eb2f669b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.163868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0797e-734b-469d-9e04-7a8b718e33bc None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.198382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74da087-0b31-4df5-be47-6574eb2f669b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.235435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:17.239131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026baec4-d658-416e-bd4a-e35912e1082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.239827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026baec4-d658-416e-bd4a-e35912e1082e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.240181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026baec4-d658-416e-bd4a-e35912e1082e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.240532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026baec4-d658-416e-bd4a-e35912e1082e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.244600 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d23770-77bd-4746-9767-a1a28bf68f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.245227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d23770-77bd-4746-9767-a1a28bf68f72 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.245512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d23770-77bd-4746-9767-a1a28bf68f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.245785 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d23770-77bd-4746-9767-a1a28bf68f72 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.246428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d23770-77bd-4746-9767-a1a28bf68f72 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:17.246734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d23770-77bd-4746-9767-a1a28bf68f72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.248216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d23770-77bd-4746-9767-a1a28bf68f72 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.260307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 367/702] 10.222.0.89 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:17.266352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d23770-77bd-4746-9767-a1a28bf68f72 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.303382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:17.324783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026baec4-d658-416e-bd4a-e35912e1082e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.327196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026baec4-d658-416e-bd4a-e35912e1082e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.450097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d23770-77bd-4746-9767-a1a28bf68f72 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.495824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 336/703] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:17.507680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dedf77-81d6-452d-a1ae-eb57c791f4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.508160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026baec4-d658-416e-bd4a-e35912e1082e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.508441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dedf77-81d6-452d-a1ae-eb57c791f4ab None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.508807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dedf77-81d6-452d-a1ae-eb57c791f4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.509144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dedf77-81d6-452d-a1ae-eb57c791f4ab None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.509850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dedf77-81d6-452d-a1ae-eb57c791f4ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:17.510217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dedf77-81d6-452d-a1ae-eb57c791f4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.511690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dedf77-81d6-452d-a1ae-eb57c791f4ab None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.518805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 368/704] 10.222.0.89 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:17.520169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667e8d-d22f-4ebc-92b5-58906713c9bf None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.520520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667e8d-d22f-4ebc-92b5-58906713c9bf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.520858 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667e8d-d22f-4ebc-92b5-58906713c9bf None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.524134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 369/705] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:17.540605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52bb69-ea87-4bd9-b465-2e503c88e50a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.540917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52bb69-ea87-4bd9-b465-2e503c88e50a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.541148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52bb69-ea87-4bd9-b465-2e503c88e50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.569796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cc52bb69-ea87-4bd9-b465-2e503c88e50a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:17.570956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cc52bb69-ea87-4bd9-b465-2e503c88e50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:17.654459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:17.674088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:17.707529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026baec4-d658-416e-bd4a-e35912e1082e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:17.708818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 370/706] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 15:27:17.752646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afee6a1-74ae-4778-bc90-cf88a489298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:17.753285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afee6a1-74ae-4778-bc90-cf88a489298d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:17.753616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afee6a1-74ae-4778-bc90-cf88a489298d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:17.753893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afee6a1-74ae-4778-bc90-cf88a489298d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:17.767570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afee6a1-74ae-4778-bc90-cf88a489298d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:17.769020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afee6a1-74ae-4778-bc90-cf88a489298d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-9afee6a1-74ae-4778-bc90-cf88a489298d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:17.796107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:17.797664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:17.799016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:17.799016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:17.799016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:17.799016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 337/707] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:17.805263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52bb69-ea87-4bd9-b465-2e503c88e50a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:17.950958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52bb69-ea87-4bd9-b465-2e503c88e50a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.021325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0f0df-5bdf-411d-8b2a-c82acf87dbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.022270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f0df-5bdf-411d-8b2a-c82acf87dbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.022716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f0df-5bdf-411d-8b2a-c82acf87dbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.023240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f0df-5bdf-411d-8b2a-c82acf87dbe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.024347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0f0df-5bdf-411d-8b2a-c82acf87dbe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:18.024847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0f0df-5bdf-411d-8b2a-c82acf87dbe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.027165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0f0df-5bdf-411d-8b2a-c82acf87dbe2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.053942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 371/708] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:18.059206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afee6a1-74ae-4778-bc90-cf88a489298d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.068141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0f0df-5bdf-411d-8b2a-c82acf87dbe2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.144199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.279791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afee6a1-74ae-4778-bc90-cf88a489298d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.296088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0f0df-5bdf-411d-8b2a-c82acf87dbe2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.335546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.343296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ae0f-0fd6-49ee-9765-628c3abc1de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.343992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ae0f-0fd6-49ee-9765-628c3abc1de2 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.344273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ae0f-0fd6-49ee-9765-628c3abc1de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.344542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ae0f-0fd6-49ee-9765-628c3abc1de2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.356880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780ae0f-0fd6-49ee-9765-628c3abc1de2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.358315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780ae0f-0fd6-49ee-9765-628c3abc1de2 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.369248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531e09-9a9c-498e-aebf-158f6355eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.369882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531e09-9a9c-498e-aebf-158f6355eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.370155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531e09-9a9c-498e-aebf-158f6355eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.370422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531e09-9a9c-498e-aebf-158f6355eaa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-b780ae0f-0fd6-49ee-9765-628c3abc1de2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:18.378551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:18.379524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:18.380446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:18.380446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:18.380446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:18.380446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:18.380446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:18.380446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:18.380446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:18.380446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:18.381922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 338/709] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:18.388284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ae0f-0fd6-49ee-9765-628c3abc1de2 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.394583 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531e09-9a9c-498e-aebf-158f6355eaa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.396056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531e09-9a9c-498e-aebf-158f6355eaa6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b7531e09-9a9c-498e-aebf-158f6355eaa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:18.423503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:18.424524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:18.425425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:18.425425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:18.425425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:18.431170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 372/710] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:18.432017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531e09-9a9c-498e-aebf-158f6355eaa6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.525747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ae0f-0fd6-49ee-9765-628c3abc1de2 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.527339 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.543545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531e09-9a9c-498e-aebf-158f6355eaa6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.562169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a61c4f-dc21-41ed-adbe-0ab932dfd697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.562909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a61c4f-dc21-41ed-adbe-0ab932dfd697 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.563222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a61c4f-dc21-41ed-adbe-0ab932dfd697 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.564021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a61c4f-dc21-41ed-adbe-0ab932dfd697 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.564736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a61c4f-dc21-41ed-adbe-0ab932dfd697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:18.565334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a61c4f-dc21-41ed-adbe-0ab932dfd697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.567468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a61c4f-dc21-41ed-adbe-0ab932dfd697 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.578081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811984e3-4ea6-420f-9f4f-ea9af9cf8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.579247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811984e3-4ea6-420f-9f4f-ea9af9cf8f2b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.579521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811984e3-4ea6-420f-9f4f-ea9af9cf8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.579787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811984e3-4ea6-420f-9f4f-ea9af9cf8f2b None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.580429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811984e3-4ea6-420f-9f4f-ea9af9cf8f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:18.580726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811984e3-4ea6-420f-9f4f-ea9af9cf8f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.582172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811984e3-4ea6-420f-9f4f-ea9af9cf8f2b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.583229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 339/711] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:18.585328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac81adc-5553-427b-a2d2-9c6bedfd03ac None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.585618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac81adc-5553-427b-a2d2-9c6bedfd03ac None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.585898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac81adc-5553-427b-a2d2-9c6bedfd03ac None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.591027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 340/712] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:18.591902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac81adc-5553-427b-a2d2-9c6bedfd03ac None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.599535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 373/713] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:18.601127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf3e4-9afd-41a9-bd53-fdd77b1cba45 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.601619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf3e4-9afd-41a9-bd53-fdd77b1cba45 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.602098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcf3e4-9afd-41a9-bd53-fdd77b1cba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.627667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bdbcf3e4-9afd-41a9-bd53-fdd77b1cba45 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:18.629565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bdbcf3e4-9afd-41a9-bd53-fdd77b1cba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:18.649323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.715717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 374/714] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:18.715717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf3e4-9afd-41a9-bd53-fdd77b1cba45 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:18.731826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac81adc-5553-427b-a2d2-9c6bedfd03ac None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.799950 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763b69c-ca2a-4447-af2d-8b910dddb85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.800473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763b69c-ca2a-4447-af2d-8b910dddb85c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.800960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763b69c-ca2a-4447-af2d-8b910dddb85c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.801231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763b69c-ca2a-4447-af2d-8b910dddb85c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.802222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763b69c-ca2a-4447-af2d-8b910dddb85c None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=5cbda75c38b04e6c89f17e655eb4f737) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:18.802537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763b69c-ca2a-4447-af2d-8b910dddb85c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.804007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763b69c-ca2a-4447-af2d-8b910dddb85c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.816395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 341/715] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:18 2022] GET /identity/v3/role_assignments?user.id=5cbda75c38b04e6c89f17e655eb4f737&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=609b1a993a394f0e900e17edccebaea5 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:18.867712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcf3e4-9afd-41a9-bd53-fdd77b1cba45 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:18.871383 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:18.934621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24513317-bef2-44c8-b1e0-d722fc3c1fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:18.935658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24513317-bef2-44c8-b1e0-d722fc3c1fbb None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:18.936149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24513317-bef2-44c8-b1e0-d722fc3c1fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:18.936648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24513317-bef2-44c8-b1e0-d722fc3c1fbb None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:18.937539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24513317-bef2-44c8-b1e0-d722fc3c1fbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:18.939832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24513317-bef2-44c8-b1e0-d722fc3c1fbb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:18.973000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 375/716] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:27:18 2022] POST /identity/v3/users => generated 254 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:19.068864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763b69c-ca2a-4447-af2d-8b910dddb85c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.179804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763b69c-ca2a-4447-af2d-8b910dddb85c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.201856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:19.217602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988a86c-89d2-44c5-a0a6-9b67bd10b4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.218243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988a86c-89d2-44c5-a0a6-9b67bd10b4fc None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.218526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988a86c-89d2-44c5-a0a6-9b67bd10b4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.218818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988a86c-89d2-44c5-a0a6-9b67bd10b4fc None admin] PATH_INFO: `/v3/services/network` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.219454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988a86c-89d2-44c5-a0a6-9b67bd10b4fc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:19.220823 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988a86c-89d2-44c5-a0a6-9b67bd10b4fc None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-1988a86c-89d2-44c5-a0a6-9b67bd10b4fc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:19.232484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:19.233522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:19.234344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 342/717] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:19.240213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24513317-bef2-44c8-b1e0-d722fc3c1fbb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.298542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e6524-e313-478c-809d-64b342d0ac12 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.298857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e6524-e313-478c-809d-64b342d0ac12 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.299117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e6524-e313-478c-809d-64b342d0ac12 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.300967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 343/718] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:19.307730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1c8a-cee2-4d4e-9824-8bdb9579c13f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.308255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1c8a-cee2-4d4e-9824-8bdb9579c13f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.308725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc1c8a-cee2-4d4e-9824-8bdb9579c13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.329261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-60dc1c8a-cee2-4d4e-9824-8bdb9579c13f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:19.331685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-60dc1c8a-cee2-4d4e-9824-8bdb9579c13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:19.357447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24513317-bef2-44c8-b1e0-d722fc3c1fbb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.394878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:19.402621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d3920-b9ed-448d-afc9-6ca3d837984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.403280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d3920-b9ed-448d-afc9-6ca3d837984f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.403566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d3920-b9ed-448d-afc9-6ca3d837984f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.403841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d3920-b9ed-448d-afc9-6ca3d837984f None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.404722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d3920-b9ed-448d-afc9-6ca3d837984f None admin] RBAC: Adding query filter params (name=network) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:19.405031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d3920-b9ed-448d-afc9-6ca3d837984f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:19.407574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d3920-b9ed-448d-afc9-6ca3d837984f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:19.411363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 344/719] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:19.414987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 376/720] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:19.420130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc1c8a-cee2-4d4e-9824-8bdb9579c13f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.536764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc1c8a-cee2-4d4e-9824-8bdb9579c13f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.548578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:19.585202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c173e-064a-4b41-a7ec-800fdd2921f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.585752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c173e-064a-4b41-a7ec-800fdd2921f8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.586042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c173e-064a-4b41-a7ec-800fdd2921f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.586315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c173e-064a-4b41-a7ec-800fdd2921f8 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.586982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c173e-064a-4b41-a7ec-800fdd2921f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:19.587294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c173e-064a-4b41-a7ec-800fdd2921f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:19.588687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c173e-064a-4b41-a7ec-800fdd2921f8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:19.595977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 345/721] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:19.784733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d3920-b9ed-448d-afc9-6ca3d837984f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:19.844982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe992525-4732-47f7-bd3c-9a48fdd36877 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.845485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe992525-4732-47f7-bd3c-9a48fdd36877 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.845485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe992525-4732-47f7-bd3c-9a48fdd36877 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.850782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 346/722] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:19.852016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316eb93-c572-4c12-a571-a88bd2016137 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.852298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316eb93-c572-4c12-a571-a88bd2016137 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.852565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316eb93-c572-4c12-a571-a88bd2016137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.880648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8316eb93-c572-4c12-a571-a88bd2016137 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:19.882016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8316eb93-c572-4c12-a571-a88bd2016137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:19.905651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d3920-b9ed-448d-afc9-6ca3d837984f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:19.943857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9248a-2126-4bba-a6aa-89cb1cac231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:19.944872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9248a-2126-4bba-a6aa-89cb1cac231f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:19.945365 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9248a-2126-4bba-a6aa-89cb1cac231f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:19.945826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9248a-2126-4bba-a6aa-89cb1cac231f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:19.958035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9248a-2126-4bba-a6aa-89cb1cac231f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:19.958770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 347/723] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2af9248a-2126-4bba-a6aa-89cb1cac231f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:19.968871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:19.969812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:19.970633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:19.972371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 377/724] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:19.978238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316eb93-c572-4c12-a571-a88bd2016137 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.091619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316eb93-c572-4c12-a571-a88bd2016137 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.093558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:20.130778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8945-5e61-41b8-9234-c7cfbb96fe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.131770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8945-5e61-41b8-9234-c7cfbb96fe6b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.132250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8945-5e61-41b8-9234-c7cfbb96fe6b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.132745 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a8945-5e61-41b8-9234-c7cfbb96fe6b None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.133618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8945-5e61-41b8-9234-c7cfbb96fe6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:20.134162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8945-5e61-41b8-9234-c7cfbb96fe6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.135773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a8945-5e61-41b8-9234-c7cfbb96fe6b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.146773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 348/725] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:20.156059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9248a-2126-4bba-a6aa-89cb1cac231f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.249833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:20.313713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9248a-2126-4bba-a6aa-89cb1cac231f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.342714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8945-5e61-41b8-9234-c7cfbb96fe6b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.373022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665ed1-eb38-4256-aba5-ef75fb80237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.373670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665ed1-eb38-4256-aba5-ef75fb80237f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.373954 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665ed1-eb38-4256-aba5-ef75fb80237f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.374225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd665ed1-eb38-4256-aba5-ef75fb80237f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.395620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd665ed1-eb38-4256-aba5-ef75fb80237f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.396992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd665ed1-eb38-4256-aba5-ef75fb80237f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-dd665ed1-eb38-4256-aba5-ef75fb80237f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:20.426020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:20.427046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:20.427915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:20.427915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:20.427915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:20.435040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 378/726] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:20.436749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665ed1-eb38-4256-aba5-ef75fb80237f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.471348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a8945-5e61-41b8-9234-c7cfbb96fe6b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.512263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc125a1-17d8-4bfd-8c71-d7005e930e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.513288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc125a1-17d8-4bfd-8c71-d7005e930e53 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.513763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc125a1-17d8-4bfd-8c71-d7005e930e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.514254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc125a1-17d8-4bfd-8c71-d7005e930e53 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.515544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc125a1-17d8-4bfd-8c71-d7005e930e53 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.517741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc125a1-17d8-4bfd-8c71-d7005e930e53 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.539186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 349/727] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:20 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:20.631272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd665ed1-eb38-4256-aba5-ef75fb80237f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.644111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:20.705982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57702c1-084e-41fa-9d29-332eca081bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.707057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57702c1-084e-41fa-9d29-332eca081bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.707552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57702c1-084e-41fa-9d29-332eca081bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.708018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57702c1-084e-41fa-9d29-332eca081bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.708866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57702c1-084e-41fa-9d29-332eca081bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:20.709361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57702c1-084e-41fa-9d29-332eca081bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.710971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57702c1-084e-41fa-9d29-332eca081bb2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.727523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 379/728] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:20.733217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc125a1-17d8-4bfd-8c71-d7005e930e53 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:20.764477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:20.900079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc125a1-17d8-4bfd-8c71-d7005e930e53 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:20.943715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554a8d9-c78c-46bc-a981-7cce23cc0736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:20.944360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a8d9-c78c-46bc-a981-7cce23cc0736 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:20.944645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a8d9-c78c-46bc-a981-7cce23cc0736 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:20.944923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a8d9-c78c-46bc-a981-7cce23cc0736 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:20.958636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554a8d9-c78c-46bc-a981-7cce23cc0736 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:20.960050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554a8d9-c78c-46bc-a981-7cce23cc0736 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-b554a8d9-c78c-46bc-a981-7cce23cc0736 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:20.975181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:20.976187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:20.977094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 350/729] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:20.982243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57702c1-084e-41fa-9d29-332eca081bb2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:21.113518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57702c1-084e-41fa-9d29-332eca081bb2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:21.149972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e50e3d-c09b-4cf5-9c83-e211d1f55665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:21.150587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50e3d-c09b-4cf5-9c83-e211d1f55665 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.150870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50e3d-c09b-4cf5-9c83-e211d1f55665 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.151179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50e3d-c09b-4cf5-9c83-e211d1f55665 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.151928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e50e3d-c09b-4cf5-9c83-e211d1f55665 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:21.152231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e50e3d-c09b-4cf5-9c83-e211d1f55665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:21.153675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e50e3d-c09b-4cf5-9c83-e211d1f55665 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:21.173846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 380/730] 10.222.0.89 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:21.179515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554a8d9-c78c-46bc-a981-7cce23cc0736 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:21.292748 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:21.312737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554a8d9-c78c-46bc-a981-7cce23cc0736 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:21.365494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d5677-34c8-4cd2-b166-dab0852c376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:21.366111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d5677-34c8-4cd2-b166-dab0852c376a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.366393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d5677-34c8-4cd2-b166-dab0852c376a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.366672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d5677-34c8-4cd2-b166-dab0852c376a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.459622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d5677-34c8-4cd2-b166-dab0852c376a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:21.461079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d5677-34c8-4cd2-b166-dab0852c376a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:21.496906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26b2a-8439-4e8f-8f0e-589a668e9f70 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.497538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26b2a-8439-4e8f-8f0e-589a668e9f70 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.498036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26b2a-8439-4e8f-8f0e-589a668e9f70 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.500929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 381/731] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:21.505833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5318-5449-4ea4-8a37-6732a3fd9b05 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.506146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5318-5449-4ea4-8a37-6732a3fd9b05 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.506391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5318-5449-4ea4-8a37-6732a3fd9b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.533744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7d6b5318-5449-4ea4-8a37-6732a3fd9b05 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:21.534970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7d6b5318-5449-4ea4-8a37-6732a3fd9b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:21.559403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:21.606338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 382/732] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:21.615291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:21.637713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 351/733] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 15:27:21.644524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b5318-5449-4ea4-8a37-6732a3fd9b05 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:21.747795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b5318-5449-4ea4-8a37-6732a3fd9b05 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:21.786855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f92d-73f9-443b-8249-f563c1f8092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:21.787531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f92d-73f9-443b-8249-f563c1f8092f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:21.787812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f92d-73f9-443b-8249-f563c1f8092f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:21.788086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f92d-73f9-443b-8249-f563c1f8092f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:21.802757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66f92d-73f9-443b-8249-f563c1f8092f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:21.804712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66f92d-73f9-443b-8249-f563c1f8092f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-be66f92d-73f9-443b-8249-f563c1f8092f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:21.821103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:21.822057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:21.822956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:21.822956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:21.822956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:21.825156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 383/734] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:21.835222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d5677-34c8-4cd2-b166-dab0852c376a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:21.883923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f92d-73f9-443b-8249-f563c1f8092f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:21.887247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.016577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d5677-34c8-4cd2-b166-dab0852c376a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.053422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f92d-73f9-443b-8249-f563c1f8092f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.058355 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de392ad4-e170-4608-be07-4317aaf71084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.059077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de392ad4-e170-4608-be07-4317aaf71084 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.059431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de392ad4-e170-4608-be07-4317aaf71084 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.059776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de392ad4-e170-4608-be07-4317aaf71084 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.060501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de392ad4-e170-4608-be07-4317aaf71084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:22.060874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de392ad4-e170-4608-be07-4317aaf71084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.062903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de392ad4-e170-4608-be07-4317aaf71084 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.077067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 352/735] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:22.078998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca604e-d004-4457-b751-c752c395792a None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.079392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca604e-d004-4457-b751-c752c395792a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.080232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca604e-d004-4457-b751-c752c395792a None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.082111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 353/736] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:22.083506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca604e-d004-4457-b751-c752c395792a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.103718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0daf-d036-4ede-910d-77aaf8db19e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.104428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0daf-d036-4ede-910d-77aaf8db19e7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.104742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0daf-d036-4ede-910d-77aaf8db19e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.105038 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0daf-d036-4ede-910d-77aaf8db19e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.123721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c0daf-d036-4ede-910d-77aaf8db19e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-cf4c0daf-d036-4ede-910d-77aaf8db19e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:22.129375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:22.131258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 384/737] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:22.133321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731925-88ce-4c86-bc54-4bf64f9e0061 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.135902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731925-88ce-4c86-bc54-4bf64f9e0061 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.135902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731925-88ce-4c86-bc54-4bf64f9e0061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.154100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.160265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f9731925-88ce-4c86-bc54-4bf64f9e0061 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:22.161474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f9731925-88ce-4c86-bc54-4bf64f9e0061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:22.221024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca604e-d004-4457-b751-c752c395792a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.221361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.238851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 385/738] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:22.239992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9731925-88ce-4c86-bc54-4bf64f9e0061 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.260494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c2030-c5ac-437d-b3b2-8ca6db0d5901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.261132 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2030-c5ac-437d-b3b2-8ca6db0d5901 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.261464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2030-c5ac-437d-b3b2-8ca6db0d5901 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.261742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2030-c5ac-437d-b3b2-8ca6db0d5901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.269603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c2030-c5ac-437d-b3b2-8ca6db0d5901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.271106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c2030-c5ac-437d-b3b2-8ca6db0d5901 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-514c2030-c5ac-437d-b3b2-8ca6db0d5901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:22.283068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:22.283968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:22.284849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:22.284849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:22.284849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:22.284849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:22.284849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:22.284849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:22.284849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:22.284849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:22.289001 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 354/739] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:22.290314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1e01d-e549-4f4e-a9fd-9b64d2c1d4f0 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.290601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1e01d-e549-4f4e-a9fd-9b64d2c1d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.290878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1e01d-e549-4f4e-a9fd-9b64d2c1d4f0 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.292438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 355/740] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:22.293155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1e01d-e549-4f4e-a9fd-9b64d2c1d4f0 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.368880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9731925-88ce-4c86-bc54-4bf64f9e0061 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.406505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed11e7f-1157-4b3f-9283-1df1c0eb8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.407167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11e7f-1157-4b3f-9283-1df1c0eb8e30 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.409247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11e7f-1157-4b3f-9283-1df1c0eb8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.409247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed11e7f-1157-4b3f-9283-1df1c0eb8e30 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.409247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed11e7f-1157-4b3f-9283-1df1c0eb8e30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:22.409247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed11e7f-1157-4b3f-9283-1df1c0eb8e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.410988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed11e7f-1157-4b3f-9283-1df1c0eb8e30 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.419059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 386/741] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:22.420315 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a1bfd-cf41-4d8d-a566-ad65689f9fdd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.420621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a1bfd-cf41-4d8d-a566-ad65689f9fdd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.420893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a1bfd-cf41-4d8d-a566-ad65689f9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.426742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1e01d-e549-4f4e-a9fd-9b64d2c1d4f0 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.430532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.440988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e36a1bfd-cf41-4d8d-a566-ad65689f9fdd None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:22.442283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e36a1bfd-cf41-4d8d-a566-ad65689f9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:22.473384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1661cf-41f2-4191-b4d4-47df93783e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.474248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1661cf-41f2-4191-b4d4-47df93783e0a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.474538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1661cf-41f2-4191-b4d4-47df93783e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.475154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1661cf-41f2-4191-b4d4-47df93783e0a None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.475898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1661cf-41f2-4191-b4d4-47df93783e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:22.476217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1661cf-41f2-4191-b4d4-47df93783e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.477685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1661cf-41f2-4191-b4d4-47df93783e0a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.493157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 356/742] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:22.494477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1661cf-41f2-4191-b4d4-47df93783e0a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.504848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.531025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 387/743] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 15:27:22.531959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a1bfd-cf41-4d8d-a566-ad65689f9fdd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.648792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1661cf-41f2-4191-b4d4-47df93783e0a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.674003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a1bfd-cf41-4d8d-a566-ad65689f9fdd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.692019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449acb4a-d93d-410b-a091-a323ac9f5993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.692691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449acb4a-d93d-410b-a091-a323ac9f5993 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.692976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449acb4a-d93d-410b-a091-a323ac9f5993 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.693254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449acb4a-d93d-410b-a091-a323ac9f5993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.713136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449acb4a-d93d-410b-a091-a323ac9f5993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.714889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449acb4a-d93d-410b-a091-a323ac9f5993 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.727037 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48122c-ee3b-494c-ab64-bc019ed08298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.728252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48122c-ee3b-494c-ab64-bc019ed08298 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.728765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48122c-ee3b-494c-ab64-bc019ed08298 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.729306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48122c-ee3b-494c-ab64-bc019ed08298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.730337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48122c-ee3b-494c-ab64-bc019ed08298 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=9df361aabe544b618c7c1c1d98b8751a) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:22.730854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48122c-ee3b-494c-ab64-bc019ed08298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-449acb4a-d93d-410b-a091-a323ac9f5993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:22.731974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:22.732943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:22.739923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:22.739923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:22.739923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:22.739923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 357/744] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:22.739923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449acb4a-d93d-410b-a091-a323ac9f5993 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.740213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48122c-ee3b-494c-ab64-bc019ed08298 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.747654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 388/745] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/role_assignments?user.id=9df361aabe544b618c7c1c1d98b8751a&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=609b1a993a394f0e900e17edccebaea5 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:22.748517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48122c-ee3b-494c-ab64-bc019ed08298 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.767585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.823351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:22.884682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449acb4a-d93d-410b-a091-a323ac9f5993 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.899370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48122c-ee3b-494c-ab64-bc019ed08298 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:22.932041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969e8da-1f0b-4e6d-81f3-17de4cdf4a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.932599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969e8da-1f0b-4e6d-81f3-17de4cdf4a80 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.932892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969e8da-1f0b-4e6d-81f3-17de4cdf4a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.933310 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969e8da-1f0b-4e6d-81f3-17de4cdf4a80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.947496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150458c-0271-42f1-84e0-cd320e215070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:22.948584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969e8da-1f0b-4e6d-81f3-17de4cdf4a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:22.948734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150458c-0271-42f1-84e0-cd320e215070 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.949135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150458c-0271-42f1-84e0-cd320e215070 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.949509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150458c-0271-42f1-84e0-cd320e215070 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.950206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150458c-0271-42f1-84e0-cd320e215070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:22.950516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150458c-0271-42f1-84e0-cd320e215070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:22.952666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150458c-0271-42f1-84e0-cd320e215070 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-6969e8da-1f0b-4e6d-81f3-17de4cdf4a80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:22.954000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:22.955222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:22.956073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:22.959348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 358/746] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:22.960963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de073e6-885a-4302-94d3-4e2b498d40cc None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:22.961254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de073e6-885a-4302-94d3-4e2b498d40cc None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:22.961548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de073e6-885a-4302-94d3-4e2b498d40cc None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:22.964094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 359/747] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:22.964094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de073e6-885a-4302-94d3-4e2b498d40cc None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:22.974247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 389/748] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:22.975529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150458c-0271-42f1-84e0-cd320e215070 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.069466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.090097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150458c-0271-42f1-84e0-cd320e215070 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.100626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de073e6-885a-4302-94d3-4e2b498d40cc None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.103644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.135352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2771b-ca57-41b0-a607-c06a65a7c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.136204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2771b-ca57-41b0-a607-c06a65a7c156 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.136514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2771b-ca57-41b0-a607-c06a65a7c156 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.136914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2771b-ca57-41b0-a607-c06a65a7c156 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.137696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2771b-ca57-41b0-a607-c06a65a7c156 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:23.139982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2771b-ca57-41b0-a607-c06a65a7c156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.139982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2771b-ca57-41b0-a607-c06a65a7c156 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.142743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c8c86-847e-4fef-b93f-b780f09bb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.143403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c8c86-847e-4fef-b93f-b780f09bb3d4 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.143679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c8c86-847e-4fef-b93f-b780f09bb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.143949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c8c86-847e-4fef-b93f-b780f09bb3d4 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.144603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c8c86-847e-4fef-b93f-b780f09bb3d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.145972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c8c86-847e-4fef-b93f-b780f09bb3d4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.148490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 390/749] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:23.155494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce9cb-1d94-468c-8b3e-8f57254069f4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.155878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce9cb-1d94-468c-8b3e-8f57254069f4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.156694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce9cb-1d94-468c-8b3e-8f57254069f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.167090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 360/750] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:22 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:23.167090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c8c86-847e-4fef-b93f-b780f09bb3d4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.184797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bc0ce9cb-1d94-468c-8b3e-8f57254069f4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:23.186029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bc0ce9cb-1d94-468c-8b3e-8f57254069f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:23.287117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 391/751] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:23.288056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ce9cb-1d94-468c-8b3e-8f57254069f4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.348361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c8c86-847e-4fef-b93f-b780f09bb3d4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.399471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e762e37-aac4-46b1-80df-14f3bd29bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.400354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e762e37-aac4-46b1-80df-14f3bd29bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.400835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e762e37-aac4-46b1-80df-14f3bd29bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.401212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e762e37-aac4-46b1-80df-14f3bd29bcb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.406145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.414810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e762e37-aac4-46b1-80df-14f3bd29bcb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.416313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e762e37-aac4-46b1-80df-14f3bd29bcb3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.422007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.430026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ce9cb-1d94-468c-8b3e-8f57254069f4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-5e762e37-aac4-46b1-80df-14f3bd29bcb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:23.430559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:23.431514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:23.433046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 361/752] 10.222.0.89 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:23.440222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e762e37-aac4-46b1-80df-14f3bd29bcb3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.475451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcfd69-b2e6-467b-97d1-e889a24346ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.477127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcfd69-b2e6-467b-97d1-e889a24346ee None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.477772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcfd69-b2e6-467b-97d1-e889a24346ee None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.478350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcfd69-b2e6-467b-97d1-e889a24346ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.492217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcfd69-b2e6-467b-97d1-e889a24346ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.494111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcfd69-b2e6-467b-97d1-e889a24346ee None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4cbcfd69-b2e6-467b-97d1-e889a24346ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:23.513684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:23.514686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:23.515913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:23.515913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:23.515913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:23.518003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 392/753] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:23.524432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcfd69-b2e6-467b-97d1-e889a24346ee None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.603057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e762e37-aac4-46b1-80df-14f3bd29bcb3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.646339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ae6e-a2f7-445c-a90c-7c2599df479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.646958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ae6e-a2f7-445c-a90c-7c2599df479d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.647226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ae6e-a2f7-445c-a90c-7c2599df479d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.647485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ae6e-a2f7-445c-a90c-7c2599df479d None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.648570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ae6e-a2f7-445c-a90c-7c2599df479d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:23.648857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ae6e-a2f7-445c-a90c-7c2599df479d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.650284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ae6e-a2f7-445c-a90c-7c2599df479d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.675165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 362/754] 10.222.0.89 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:23.676957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ae6e-a2f7-445c-a90c-7c2599df479d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.680868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcfd69-b2e6-467b-97d1-e889a24346ee None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.718584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1832afd-5147-4c4e-803c-ead01e589a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.719259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1832afd-5147-4c4e-803c-ead01e589a24 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.719536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1832afd-5147-4c4e-803c-ead01e589a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.719806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1832afd-5147-4c4e-803c-ead01e589a24 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.720970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1832afd-5147-4c4e-803c-ead01e589a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:23.720970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1832afd-5147-4c4e-803c-ead01e589a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.722254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1832afd-5147-4c4e-803c-ead01e589a24 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.736209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 393/755] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:23.737208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1832afd-5147-4c4e-803c-ead01e589a24 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.746974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.749763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:23.802264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ae6e-a2f7-445c-a90c-7c2599df479d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.843512 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1df6f-a9b9-46fa-bd0b-bc3a78baa1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.845039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1df6f-a9b9-46fa-bd0b-bc3a78baa1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.845504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1df6f-a9b9-46fa-bd0b-bc3a78baa1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.846013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1df6f-a9b9-46fa-bd0b-bc3a78baa1d9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.846948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1df6f-a9b9-46fa-bd0b-bc3a78baa1d9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.848567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1df6f-a9b9-46fa-bd0b-bc3a78baa1d9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.849507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1832afd-5147-4c4e-803c-ead01e589a24 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-bea1df6f-a9b9-46fa-bd0b-bc3a78baa1d9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:23.859574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:23.860694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:23.861635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:23.864676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 363/756] 10.222.0.89 () {56 vars in 1129 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:23.866192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1df6f-a9b9-46fa-bd0b-bc3a78baa1d9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.891279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316d5d-1b53-493a-a7d7-8320e5e6ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:23.892013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316d5d-1b53-493a-a7d7-8320e5e6ff97 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:23.892293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316d5d-1b53-493a-a7d7-8320e5e6ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:23.892562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316d5d-1b53-493a-a7d7-8320e5e6ff97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:23.903963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316d5d-1b53-493a-a7d7-8320e5e6ff97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:23.905529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316d5d-1b53-493a-a7d7-8320e5e6ff97 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b8316d5d-1b53-493a-a7d7-8320e5e6ff97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:23.921671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:23.922684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:23.923605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:23.923605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:23.923605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:23.927910 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 394/757] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:23.928747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316d5d-1b53-493a-a7d7-8320e5e6ff97 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:23.981850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1df6f-a9b9-46fa-bd0b-bc3a78baa1d9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:23.996648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.005209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.025980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c91e-a33f-4d03-a77a-33239db6968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.026737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c91e-a33f-4d03-a77a-33239db6968f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.027106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c91e-a33f-4d03-a77a-33239db6968f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.027437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2c91e-a33f-4d03-a77a-33239db6968f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.037558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c91e-a33f-4d03-a77a-33239db6968f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.039268 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2c91e-a33f-4d03-a77a-33239db6968f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-13a2c91e-a33f-4d03-a77a-33239db6968f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:24.051406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:24.052337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:24.053282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:24.055761 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 364/758] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:24.056167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316d5d-1b53-493a-a7d7-8320e5e6ff97 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.057039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c91e-a33f-4d03-a77a-33239db6968f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.111748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b003d5-b627-4f15-8b21-d0ab75d25f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.112446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b003d5-b627-4f15-8b21-d0ab75d25f2e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.112724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b003d5-b627-4f15-8b21-d0ab75d25f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.113011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b003d5-b627-4f15-8b21-d0ab75d25f2e None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.113734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b003d5-b627-4f15-8b21-d0ab75d25f2e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.114068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b003d5-b627-4f15-8b21-d0ab75d25f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.115519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b003d5-b627-4f15-8b21-d0ab75d25f2e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.123012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 395/759] 10.222.0.89 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.123187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b003d5-b627-4f15-8b21-d0ab75d25f2e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.200079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2c91e-a33f-4d03-a77a-33239db6968f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.244535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b003d5-b627-4f15-8b21-d0ab75d25f2e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.248456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e190f-200f-4056-b5dc-567e7d9c7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.249177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e190f-200f-4056-b5dc-567e7d9c7f80 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.249537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e190f-200f-4056-b5dc-567e7d9c7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.249887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e190f-200f-4056-b5dc-567e7d9c7f80 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.251160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e190f-200f-4056-b5dc-567e7d9c7f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.251544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e190f-200f-4056-b5dc-567e7d9c7f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.252998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e190f-200f-4056-b5dc-567e7d9c7f80 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.269985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 365/760] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.271064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e190f-200f-4056-b5dc-567e7d9c7f80 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.278340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.292461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b112ba-f284-4f96-9056-5010c6ab6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.293449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b112ba-f284-4f96-9056-5010c6ab6c67 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.294079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b112ba-f284-4f96-9056-5010c6ab6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.294586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b112ba-f284-4f96-9056-5010c6ab6c67 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.295640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b112ba-f284-4f96-9056-5010c6ab6c67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.296266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b112ba-f284-4f96-9056-5010c6ab6c67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.298990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b112ba-f284-4f96-9056-5010c6ab6c67 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.320891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.321230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 396/761] 10.222.0.89 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.323104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b112ba-f284-4f96-9056-5010c6ab6c67 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.397893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e190f-200f-4056-b5dc-567e7d9c7f80 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.443962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78357a-15db-4bb8-85e3-6e9733be8779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.445648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78357a-15db-4bb8-85e3-6e9733be8779 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.446131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78357a-15db-4bb8-85e3-6e9733be8779 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.446601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78357a-15db-4bb8-85e3-6e9733be8779 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.447307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b112ba-f284-4f96-9056-5010c6ab6c67 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.447871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78357a-15db-4bb8-85e3-6e9733be8779 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.448383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78357a-15db-4bb8-85e3-6e9733be8779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.451231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78357a-15db-4bb8-85e3-6e9733be8779 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.457709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 366/762] 10.222.0.89 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.458769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78357a-15db-4bb8-85e3-6e9733be8779 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.508306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604b525-8b19-4458-b0b4-c4fe910b0d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.509332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604b525-8b19-4458-b0b4-c4fe910b0d8a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.509787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604b525-8b19-4458-b0b4-c4fe910b0d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.510253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604b525-8b19-4458-b0b4-c4fe910b0d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.519355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604b525-8b19-4458-b0b4-c4fe910b0d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.520893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604b525-8b19-4458-b0b4-c4fe910b0d8a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2604b525-8b19-4458-b0b4-c4fe910b0d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:24.532839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:24.533792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:24.534680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:24.534680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:24.534680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:24.534680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:24.534680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:24.534680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:24.534680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:24.534680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:24.538890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 397/763] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:24.539800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604b525-8b19-4458-b0b4-c4fe910b0d8a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.588565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.590685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78357a-15db-4bb8-85e3-6e9733be8779 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.592832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.636045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ac49-742b-4517-9161-ba2f05b824bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.637112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ac49-742b-4517-9161-ba2f05b824bb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.637706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ac49-742b-4517-9161-ba2f05b824bb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.638426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ac49-742b-4517-9161-ba2f05b824bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.653149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604b525-8b19-4458-b0b4-c4fe910b0d8a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.690881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8d1ee-512d-480b-a980-7d629f4c5650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.691534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d1ee-512d-480b-a980-7d629f4c5650 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.691815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d1ee-512d-480b-a980-7d629f4c5650 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.692092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8d1ee-512d-480b-a980-7d629f4c5650 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.692960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8d1ee-512d-480b-a980-7d629f4c5650 None admin] RBAC: Adding query filter params (interface=public, service_id=dea5da5cd84a4d869504dfa6680d9591, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.693153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8d1ee-512d-480b-a980-7d629f4c5650 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.694494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8d1ee-512d-480b-a980-7d629f4c5650 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.703655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 398/764] 10.222.0.89 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/endpoints?service_id=dea5da5cd84a4d869504dfa6680d9591&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.704625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8d1ee-512d-480b-a980-7d629f4c5650 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.720998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011ac49-742b-4517-9161-ba2f05b824bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.722794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011ac49-742b-4517-9161-ba2f05b824bb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.816101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8d1ee-512d-480b-a980-7d629f4c5650 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.824147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.843928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 367/765] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:24.845128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ac49-742b-4517-9161-ba2f05b824bb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.847734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:24.854871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ed880-9bbd-4d42-ba73-8249f62728b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:24.855530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ed880-9bbd-4d42-ba73-8249f62728b0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:24.855819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ed880-9bbd-4d42-ba73-8249f62728b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:24.856089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ed880-9bbd-4d42-ba73-8249f62728b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:24.857007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ed880-9bbd-4d42-ba73-8249f62728b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:24.857135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ed880-9bbd-4d42-ba73-8249f62728b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:24.858678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ed880-9bbd-4d42-ba73-8249f62728b0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:24.877675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 399/766] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:24.878693 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ed880-9bbd-4d42-ba73-8249f62728b0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:24.962303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ac49-742b-4517-9161-ba2f05b824bb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:24.992490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ed880-9bbd-4d42-ba73-8249f62728b0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.001993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a0d9-96dd-4807-a0e1-10c7cf02c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.002591 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a0d9-96dd-4807-a0e1-10c7cf02c505 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.002865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a0d9-96dd-4807-a0e1-10c7cf02c505 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.003177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a0d9-96dd-4807-a0e1-10c7cf02c505 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.003783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a0d9-96dd-4807-a0e1-10c7cf02c505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.005136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a0d9-96dd-4807-a0e1-10c7cf02c505 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.014984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 368/767] 10.222.0.89 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:25.014984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a0d9-96dd-4807-a0e1-10c7cf02c505 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.051824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274d781-7855-4255-bc22-3a73098453c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.052614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274d781-7855-4255-bc22-3a73098453c8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.052967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274d781-7855-4255-bc22-3a73098453c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.053318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274d781-7855-4255-bc22-3a73098453c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.068776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274d781-7855-4255-bc22-3a73098453c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.070590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274d781-7855-4255-bc22-3a73098453c8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a274d781-7855-4255-bc22-3a73098453c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:25.090580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:25.091901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:25.093099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:25.093099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:25.093099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:25.095116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 400/768] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:25.097113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7691-9a7a-4248-b1dd-49e53e7aebb6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.097721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7691-9a7a-4248-b1dd-49e53e7aebb6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.099374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7691-9a7a-4248-b1dd-49e53e7aebb6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.105318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 401/769] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:25.105318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab7691-9a7a-4248-b1dd-49e53e7aebb6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.131138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.151330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.204698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a0d9-96dd-4807-a0e1-10c7cf02c505 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.248254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab7691-9a7a-4248-b1dd-49e53e7aebb6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.253466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a46286-7e51-4d96-8515-210785825165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.254145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a46286-7e51-4d96-8515-210785825165 None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.254422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a46286-7e51-4d96-8515-210785825165 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.254691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a46286-7e51-4d96-8515-210785825165 None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/5cbda75c38b04e6c89f17e655eb4f737/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.256669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a46286-7e51-4d96-8515-210785825165 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=5cbda75c38b04e6c89f17e655eb4f737, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.258676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a46286-7e51-4d96-8515-210785825165 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.275455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 369/770] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:25 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/5cbda75c38b04e6c89f17e655eb4f737/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:25.276689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2974d-75a4-43ff-82c9-1c44c88ad704 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.277029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2974d-75a4-43ff-82c9-1c44c88ad704 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.277307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2974d-75a4-43ff-82c9-1c44c88ad704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.294382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9365a1-11b0-49b1-b989-6292c50c9762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.295420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9365a1-11b0-49b1-b989-6292c50c9762 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.295960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9365a1-11b0-49b1-b989-6292c50c9762 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.296468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9365a1-11b0-49b1-b989-6292c50c9762 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.297472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9365a1-11b0-49b1-b989-6292c50c9762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:25.297986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9365a1-11b0-49b1-b989-6292c50c9762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.298109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ebb2974d-75a4-43ff-82c9-1c44c88ad704 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:25.299424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ebb2974d-75a4-43ff-82c9-1c44c88ad704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:25.300014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9365a1-11b0-49b1-b989-6292c50c9762 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.316027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 402/771] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:25.321796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9365a1-11b0-49b1-b989-6292c50c9762 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.383286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 370/772] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:25.414806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.440357 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9365a1-11b0-49b1-b989-6292c50c9762 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.480228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0fd9d-7df3-44c6-9369-dede011d015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.481260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0fd9d-7df3-44c6-9369-dede011d015b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.481748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0fd9d-7df3-44c6-9369-dede011d015b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.482241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0fd9d-7df3-44c6-9369-dede011d015b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.490592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0fd9d-7df3-44c6-9369-dede011d015b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.492426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0fd9d-7df3-44c6-9369-dede011d015b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d3b0fd9d-7df3-44c6-9369-dede011d015b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:25.506195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:25.507141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:25.508003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:25.508003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:25.508003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:25.508003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:25.508003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:25.508003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:25.508003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:25.508003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:25.510502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 403/773] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:25.520188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2974d-75a4-43ff-82c9-1c44c88ad704 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.526564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b909e-173d-44a2-8fc9-6ad99b68ca73 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.527202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b909e-173d-44a2-8fc9-6ad99b68ca73 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.527702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b909e-173d-44a2-8fc9-6ad99b68ca73 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.529330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 404/774] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:25.539283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259eafc-d398-4e98-8c21-11165c7214c7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.539627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259eafc-d398-4e98-8c21-11165c7214c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.539969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259eafc-d398-4e98-8c21-11165c7214c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.561563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3259eafc-d398-4e98-8c21-11165c7214c7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:25.563473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3259eafc-d398-4e98-8c21-11165c7214c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:25.611168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.673282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 405/775] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:25.697666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2974d-75a4-43ff-82c9-1c44c88ad704 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.754339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02185c7-2d2b-4ef5-8720-2fe6d2b8a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.755279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02185c7-2d2b-4ef5-8720-2fe6d2b8a709 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.755722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02185c7-2d2b-4ef5-8720-2fe6d2b8a709 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.756163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02185c7-2d2b-4ef5-8720-2fe6d2b8a709 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.757076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02185c7-2d2b-4ef5-8720-2fe6d2b8a709 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:25.757584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02185c7-2d2b-4ef5-8720-2fe6d2b8a709 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:25.759178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02185c7-2d2b-4ef5-8720-2fe6d2b8a709 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:25.774856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259eafc-d398-4e98-8c21-11165c7214c7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.776599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 371/776] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:25.784686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02185c7-2d2b-4ef5-8720-2fe6d2b8a709 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.854947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:25.895241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259eafc-d398-4e98-8c21-11165c7214c7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:25.934076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a0127-208d-440a-9bf2-1b581e9c5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:25.935268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a0127-208d-440a-9bf2-1b581e9c5120 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:25.935696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a0127-208d-440a-9bf2-1b581e9c5120 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:25.936109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a0127-208d-440a-9bf2-1b581e9c5120 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:25.948415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a0127-208d-440a-9bf2-1b581e9c5120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-000a0127-208d-440a-9bf2-1b581e9c5120 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:25.954393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:25.955722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:25.956952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:25.959256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 406/777] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:25.966124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a0127-208d-440a-9bf2-1b581e9c5120 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:25.994465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02185c7-2d2b-4ef5-8720-2fe6d2b8a709 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.015395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.042872 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1eecf-4d82-49f7-bcd5-2750539a288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.044309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1eecf-4d82-49f7-bcd5-2750539a288c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.044836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1eecf-4d82-49f7-bcd5-2750539a288c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.045252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1eecf-4d82-49f7-bcd5-2750539a288c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.046278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1eecf-4d82-49f7-bcd5-2750539a288c None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=b91335b29d0b43d5993c44a3e40d4a5b) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.049207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1eecf-4d82-49f7-bcd5-2750539a288c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.051246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1eecf-4d82-49f7-bcd5-2750539a288c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.058662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 372/778] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/role_assignments?user.id=b91335b29d0b43d5993c44a3e40d4a5b&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:26.060183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1eecf-4d82-49f7-bcd5-2750539a288c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.132299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a0127-208d-440a-9bf2-1b581e9c5120 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.193797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.204494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3275-3dcf-4dac-8ecc-298ae8666e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.205497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3275-3dcf-4dac-8ecc-298ae8666e98 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.205995 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3275-3dcf-4dac-8ecc-298ae8666e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.206460 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3275-3dcf-4dac-8ecc-298ae8666e98 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.207435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df3275-3dcf-4dac-8ecc-298ae8666e98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.207963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df3275-3dcf-4dac-8ecc-298ae8666e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.209580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df3275-3dcf-4dac-8ecc-298ae8666e98 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.220423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 407/779] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:26.227883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3275-3dcf-4dac-8ecc-298ae8666e98 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.252977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1eecf-4d82-49f7-bcd5-2750539a288c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.291070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c0791-fc13-4cc5-b5e1-0e35d3452068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.291736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c0791-fc13-4cc5-b5e1-0e35d3452068 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.292019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c0791-fc13-4cc5-b5e1-0e35d3452068 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.292286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c0791-fc13-4cc5-b5e1-0e35d3452068 None admin] PATH_INFO: `/v3/services/network` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.292874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c0791-fc13-4cc5-b5e1-0e35d3452068 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.299863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c0791-fc13-4cc5-b5e1-0e35d3452068 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-1e2c0791-fc13-4cc5-b5e1-0e35d3452068 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:26.310102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:26.311177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:26.312029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 373/780] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:26.317888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c0791-fc13-4cc5-b5e1-0e35d3452068 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.469279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3275-3dcf-4dac-8ecc-298ae8666e98 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.510788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29fd39-a9a5-4da8-af4f-fc41408b96e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.511428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.512759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29fd39-a9a5-4da8-af4f-fc41408b96e8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.513416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29fd39-a9a5-4da8-af4f-fc41408b96e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.513838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29fd39-a9a5-4da8-af4f-fc41408b96e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.628229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c0791-fc13-4cc5-b5e1-0e35d3452068 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.694960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05321842-aa2c-43a1-a4f1-80e9eb8ed862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.694960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05321842-aa2c-43a1-a4f1-80e9eb8ed862 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.694960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05321842-aa2c-43a1-a4f1-80e9eb8ed862 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.694960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05321842-aa2c-43a1-a4f1-80e9eb8ed862 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.695375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05321842-aa2c-43a1-a4f1-80e9eb8ed862 None admin] RBAC: Adding query filter params (name=network) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.695375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05321842-aa2c-43a1-a4f1-80e9eb8ed862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.695375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05321842-aa2c-43a1-a4f1-80e9eb8ed862 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.707371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 374/781] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:26.707876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29fd39-a9a5-4da8-af4f-fc41408b96e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.709392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29fd39-a9a5-4da8-af4f-fc41408b96e8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.711543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05321842-aa2c-43a1-a4f1-80e9eb8ed862 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1d29fd39-a9a5-4da8-af4f-fc41408b96e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:26.745177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:26.746184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:26.747087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:26.747087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:26.747087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:26.747087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 408/782] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 519 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:26.754345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29fd39-a9a5-4da8-af4f-fc41408b96e8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:26.853635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05321842-aa2c-43a1-a4f1-80e9eb8ed862 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:26.867226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.875741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:26.890372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9240ef-6602-4b68-8f43-b4d21bee0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:26.891032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9240ef-6602-4b68-8f43-b4d21bee0405 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:26.891324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9240ef-6602-4b68-8f43-b4d21bee0405 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:26.891606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9240ef-6602-4b68-8f43-b4d21bee0405 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:26.892250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9240ef-6602-4b68-8f43-b4d21bee0405 None admin] RBAC: Adding query filter params (type=network) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:26.892562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9240ef-6602-4b68-8f43-b4d21bee0405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:26.894232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9240ef-6602-4b68-8f43-b4d21bee0405 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:26.899487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 375/783] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:26.905187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9240ef-6602-4b68-8f43-b4d21bee0405 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.017922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9240ef-6602-4b68-8f43-b4d21bee0405 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.058043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630dfa0-e8ae-428f-acd4-b67374b3c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.058785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630dfa0-e8ae-428f-acd4-b67374b3c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.059100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630dfa0-e8ae-428f-acd4-b67374b3c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.059374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630dfa0-e8ae-428f-acd4-b67374b3c6b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.060090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630dfa0-e8ae-428f-acd4-b67374b3c6b2 None admin] RBAC: Adding query filter params (interface=public, service_id=5d1c85bf472f4451b298c67417122a52, region_id=RegionOne) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:27.060401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630dfa0-e8ae-428f-acd4-b67374b3c6b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.061851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630dfa0-e8ae-428f-acd4-b67374b3c6b2 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.074066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29fd39-a9a5-4da8-af4f-fc41408b96e8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.075186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 376/784] 10.222.0.89 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/endpoints?service_id=5d1c85bf472f4451b298c67417122a52&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:27.077219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630dfa0-e8ae-428f-acd4-b67374b3c6b2 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.131385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:27.196333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630dfa0-e8ae-428f-acd4-b67374b3c6b2 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.216305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe4c4-dc2e-4956-975c-89979d68acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.216981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe4c4-dc2e-4956-975c-89979d68acea None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.217226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe4c4-dc2e-4956-975c-89979d68acea None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.217590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe4c4-dc2e-4956-975c-89979d68acea None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.218255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe4c4-dc2e-4956-975c-89979d68acea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:27.219225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe4c4-dc2e-4956-975c-89979d68acea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.220763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe4c4-dc2e-4956-975c-89979d68acea None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.237874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2fb4a-6412-4889-bb96-ebd92fc47938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.239110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2fb4a-6412-4889-bb96-ebd92fc47938 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.239409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2fb4a-6412-4889-bb96-ebd92fc47938 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.239692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2fb4a-6412-4889-bb96-ebd92fc47938 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.240326 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2fb4a-6412-4889-bb96-ebd92fc47938 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.241739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2fb4a-6412-4889-bb96-ebd92fc47938 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.248290 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 377/785] 10.222.0.89 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:27.266344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 409/786] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:27.276144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2fb4a-6412-4889-bb96-ebd92fc47938 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.468862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:27.471812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2fb4a-6412-4889-bb96-ebd92fc47938 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.516732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942c821-5985-4d68-8348-f7158b961acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.517375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942c821-5985-4d68-8348-f7158b961acb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.517651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942c821-5985-4d68-8348-f7158b961acb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.517922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942c821-5985-4d68-8348-f7158b961acb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.525905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942c821-5985-4d68-8348-f7158b961acb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.527386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942c821-5985-4d68-8348-f7158b961acb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-5942c821-5985-4d68-8348-f7158b961acb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:27.539170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:27.540136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:27.541086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 378/787] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:27.546067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe4c4-dc2e-4956-975c-89979d68acea None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.647270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fd91e-84b3-4e75-8b34-a1d97d7be4d9 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.647909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fd91e-84b3-4e75-8b34-a1d97d7be4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.648386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fd91e-84b3-4e75-8b34-a1d97d7be4d9 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.650312 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 379/788] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:27.655265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd5de-3559-4812-9aef-05a955da0313 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.655827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd5de-3559-4812-9aef-05a955da0313 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.656845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd5de-3559-4812-9aef-05a955da0313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.677529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe4c4-dc2e-4956-975c-89979d68acea None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.683172 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7c5dd5de-3559-4812-9aef-05a955da0313 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:27.684602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7c5dd5de-3559-4812-9aef-05a955da0313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:27.685095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:27.737244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7c014-75b9-4f68-921d-6f5336e743da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.737874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c014-75b9-4f68-921d-6f5336e743da None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.738228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c014-75b9-4f68-921d-6f5336e743da None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.738590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7c014-75b9-4f68-921d-6f5336e743da None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.742971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7c014-75b9-4f68-921d-6f5336e743da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:27.742971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7c014-75b9-4f68-921d-6f5336e743da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:27.742971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7c014-75b9-4f68-921d-6f5336e743da None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:27.761956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 410/789] 10.222.0.89 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:27.772565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb2c23-90b2-437f-abc2-e4dfec1168bc None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.773071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb2c23-90b2-437f-abc2-e4dfec1168bc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.773485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb2c23-90b2-437f-abc2-e4dfec1168bc None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.775273 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 411/790] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:27.776172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb2c23-90b2-437f-abc2-e4dfec1168bc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:27.815037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 380/791] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:27.816799 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a224168-6aa4-4ef6-91c0-2c8a883c212d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.817236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a224168-6aa4-4ef6-91c0-2c8a883c212d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.817815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a224168-6aa4-4ef6-91c0-2c8a883c212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:27.838192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5a224168-6aa4-4ef6-91c0-2c8a883c212d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:27.839906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5a224168-6aa4-4ef6-91c0-2c8a883c212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:27.945118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb2c23-90b2-437f-abc2-e4dfec1168bc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:27.963456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 381/792] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:27.994599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e2b04-ddce-4c23-8807-c0f9f1b7b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:27.995190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e2b04-ddce-4c23-8807-c0f9f1b7b533 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:27.995469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e2b04-ddce-4c23-8807-c0f9f1b7b533 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:27.995762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e2b04-ddce-4c23-8807-c0f9f1b7b533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.007099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e2b04-ddce-4c23-8807-c0f9f1b7b533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.008591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e2b04-ddce-4c23-8807-c0f9f1b7b533 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2e8e2b04-ddce-4c23-8807-c0f9f1b7b533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:28.025451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:28.026631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:28.027595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:28.027595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:28.027595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:28.027595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 412/793] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:28.040119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a224168-6aa4-4ef6-91c0-2c8a883c212d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.071595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.148202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e2b04-ddce-4c23-8807-c0f9f1b7b533 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.179361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.197401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a224168-6aa4-4ef6-91c0-2c8a883c212d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.311351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e2b04-ddce-4c23-8807-c0f9f1b7b533 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.324342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943bfb6-a237-4061-b33a-29999b8374c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.325040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943bfb6-a237-4061-b33a-29999b8374c4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.325263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943bfb6-a237-4061-b33a-29999b8374c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.325538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943bfb6-a237-4061-b33a-29999b8374c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.326204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943bfb6-a237-4061-b33a-29999b8374c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:28.326520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943bfb6-a237-4061-b33a-29999b8374c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.328073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943bfb6-a237-4061-b33a-29999b8374c4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.347516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 382/794] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:28.348905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943bfb6-a237-4061-b33a-29999b8374c4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.352448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c613b4-fd5e-40f1-9566-83f8f3c5c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.353932 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c613b4-fd5e-40f1-9566-83f8f3c5c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.354223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c613b4-fd5e-40f1-9566-83f8f3c5c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.354499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c613b4-fd5e-40f1-9566-83f8f3c5c6f0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.355129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c613b4-fd5e-40f1-9566-83f8f3c5c6f0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.356510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c613b4-fd5e-40f1-9566-83f8f3c5c6f0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-32c613b4-fd5e-40f1-9566-83f8f3c5c6f0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:28.367947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:28.369108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:28.369965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 413/795] 10.222.0.89 () {56 vars in 1129 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:28.370856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c613b4-fd5e-40f1-9566-83f8f3c5c6f0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.471104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.483530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.499643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c613b4-fd5e-40f1-9566-83f8f3c5c6f0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.505349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943bfb6-a237-4061-b33a-29999b8374c4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.542458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54e0d6-bcc1-448d-9462-5284f33643e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.543134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54e0d6-bcc1-448d-9462-5284f33643e7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.543404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54e0d6-bcc1-448d-9462-5284f33643e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.543677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54e0d6-bcc1-448d-9462-5284f33643e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.547958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ad5ca-bba4-4d36-8b81-6b4036c7c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.548559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ad5ca-bba4-4d36-8b81-6b4036c7c6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.548836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ad5ca-bba4-4d36-8b81-6b4036c7c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.549107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ad5ca-bba4-4d36-8b81-6b4036c7c6e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.551772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54e0d6-bcc1-448d-9462-5284f33643e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.553221 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54e0d6-bcc1-448d-9462-5284f33643e7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.560866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ad5ca-bba4-4d36-8b81-6b4036c7c6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-3a54e0d6-bcc1-448d-9462-5284f33643e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:28.565486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:28.566334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:28.567873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:28.567873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:28.567873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:28.567873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:28.567873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:28.567873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:28.567873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:28.567873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-f34ad5ca-bba4-4d36-8b81-6b4036c7c6e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:28.568322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:28.569179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:28.569996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:28.570618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 414/796] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:28.570618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54e0d6-bcc1-448d-9462-5284f33643e7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.571997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 383/797] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:28.573196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d59bd-a929-4ff5-a3a0-d89b773fb953 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.573461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d59bd-a929-4ff5-a3a0-d89b773fb953 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.573708 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d59bd-a929-4ff5-a3a0-d89b773fb953 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.578855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 384/798] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:28.579697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d59bd-a929-4ff5-a3a0-d89b773fb953 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.692319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54e0d6-bcc1-448d-9462-5284f33643e7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.705597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d59bd-a929-4ff5-a3a0-d89b773fb953 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.737715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4d308-4e0a-4736-b6ad-d93ba43d15a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.738330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4d308-4e0a-4736-b6ad-d93ba43d15a0 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.738604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4d308-4e0a-4736-b6ad-d93ba43d15a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.738872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4d308-4e0a-4736-b6ad-d93ba43d15a0 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.739534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4d308-4e0a-4736-b6ad-d93ba43d15a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:28.739833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4d308-4e0a-4736-b6ad-d93ba43d15a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.741220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4d308-4e0a-4736-b6ad-d93ba43d15a0 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.744003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.748763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 415/799] 10.222.0.89 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:28.749646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4d308-4e0a-4736-b6ad-d93ba43d15a0 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.758476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfd15f-1c0f-43ed-a8a2-0cdb78434c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.759410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfd15f-1c0f-43ed-a8a2-0cdb78434c10 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.759864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfd15f-1c0f-43ed-a8a2-0cdb78434c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.760342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfd15f-1c0f-43ed-a8a2-0cdb78434c10 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.761232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfd15f-1c0f-43ed-a8a2-0cdb78434c10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:28.761765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfd15f-1c0f-43ed-a8a2-0cdb78434c10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.763518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfd15f-1c0f-43ed-a8a2-0cdb78434c10 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.775397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:28.787459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 385/800] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:28.787459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d50ec-45cb-4b12-90c4-61380e22f7c6 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.787459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d50ec-45cb-4b12-90c4-61380e22f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.787459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d50ec-45cb-4b12-90c4-61380e22f7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.807651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8c8d50ec-45cb-4b12-90c4-61380e22f7c6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:28.809373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8c8d50ec-45cb-4b12-90c4-61380e22f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:28.877928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4d308-4e0a-4736-b6ad-d93ba43d15a0 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:28.894274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 386/801] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:28.895268 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d50ec-45cb-4b12-90c4-61380e22f7c6 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:28.928451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8badd-e0ce-41ac-b7f6-dd99f4db5512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:28.929598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8badd-e0ce-41ac-b7f6-dd99f4db5512 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:28.929935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8badd-e0ce-41ac-b7f6-dd99f4db5512 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:28.930272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8badd-e0ce-41ac-b7f6-dd99f4db5512 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:28.931051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8badd-e0ce-41ac-b7f6-dd99f4db5512 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:28.931470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8badd-e0ce-41ac-b7f6-dd99f4db5512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:28.932945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8badd-e0ce-41ac-b7f6-dd99f4db5512 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:28.947680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 416/802] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:28.947680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8badd-e0ce-41ac-b7f6-dd99f4db5512 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.034052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.035822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d50ec-45cb-4b12-90c4-61380e22f7c6 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.070109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.077596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13956-5d60-47da-8aa1-7f28f701a0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.078818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13956-5d60-47da-8aa1-7f28f701a0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.079286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13956-5d60-47da-8aa1-7f28f701a0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.079522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef13956-5d60-47da-8aa1-7f28f701a0c9 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.080232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13956-5d60-47da-8aa1-7f28f701a0c9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:29.080592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13956-5d60-47da-8aa1-7f28f701a0c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.082035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef13956-5d60-47da-8aa1-7f28f701a0c9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.087924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 387/803] 10.222.0.89 () {56 vars in 1124 bytes} [Fri Aug 26 15:27:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:29.089237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13956-5d60-47da-8aa1-7f28f701a0c9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.100515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8badd-e0ce-41ac-b7f6-dd99f4db5512 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.147007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd53b5c-7e7e-4c8c-9fc3-90046cbdf8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.147513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd53b5c-7e7e-4c8c-9fc3-90046cbdf8ab None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.147859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd53b5c-7e7e-4c8c-9fc3-90046cbdf8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.148201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd53b5c-7e7e-4c8c-9fc3-90046cbdf8ab None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/9df361aabe544b618c7c1c1d98b8751a/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.150172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd53b5c-7e7e-4c8c-9fc3-90046cbdf8ab None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=9df361aabe544b618c7c1c1d98b8751a, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.151926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd53b5c-7e7e-4c8c-9fc3-90046cbdf8ab None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.167177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 417/804] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:28 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/9df361aabe544b618c7c1c1d98b8751a/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:29.168387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd53b5c-7e7e-4c8c-9fc3-90046cbdf8ab None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.231607 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef13956-5d60-47da-8aa1-7f28f701a0c9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.272185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be30c5-906c-4181-9576-258ae0cc327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.272840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be30c5-906c-4181-9576-258ae0cc327f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.273125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be30c5-906c-4181-9576-258ae0cc327f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.273398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be30c5-906c-4181-9576-258ae0cc327f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.287553 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be30c5-906c-4181-9576-258ae0cc327f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.289336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be30c5-906c-4181-9576-258ae0cc327f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.295799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd53b5c-7e7e-4c8c-9fc3-90046cbdf8ab None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-88be30c5-906c-4181-9576-258ae0cc327f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:29.307749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:29.308878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:29.309765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:29.309765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:29.309765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:29.309765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 388/805] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:29.310419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be30c5-906c-4181-9576-258ae0cc327f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.324097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.338898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f165ae-f709-4d3d-8a98-e8ebf31d39de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.339898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f165ae-f709-4d3d-8a98-e8ebf31d39de None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.340237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f165ae-f709-4d3d-8a98-e8ebf31d39de None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.340609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f165ae-f709-4d3d-8a98-e8ebf31d39de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.341603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f165ae-f709-4d3d-8a98-e8ebf31d39de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.343446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f165ae-f709-4d3d-8a98-e8ebf31d39de None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.371693 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 418/806] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:29.372814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f165ae-f709-4d3d-8a98-e8ebf31d39de None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.383528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.460549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be30c5-906c-4181-9576-258ae0cc327f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.500633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f165ae-f709-4d3d-8a98-e8ebf31d39de None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.506448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9c262-31bd-4970-af13-0ec89603dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.507319 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c262-31bd-4970-af13-0ec89603dabb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.507703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c262-31bd-4970-af13-0ec89603dabb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.508083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c262-31bd-4970-af13-0ec89603dabb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.520960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9c262-31bd-4970-af13-0ec89603dabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-dfd9c262-31bd-4970-af13-0ec89603dabb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:29.526887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:29.527979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:29.528776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:29.529384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 389/807] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:29.535109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9c262-31bd-4970-af13-0ec89603dabb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.548653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599a8de-ac27-4b88-a561-9f1df7479947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.549320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599a8de-ac27-4b88-a561-9f1df7479947 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.549601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599a8de-ac27-4b88-a561-9f1df7479947 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.549915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599a8de-ac27-4b88-a561-9f1df7479947 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.550633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599a8de-ac27-4b88-a561-9f1df7479947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:29.550952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599a8de-ac27-4b88-a561-9f1df7479947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.552389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599a8de-ac27-4b88-a561-9f1df7479947 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.566417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 419/808] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:29.573729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599a8de-ac27-4b88-a561-9f1df7479947 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.627827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.700698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9c262-31bd-4970-af13-0ec89603dabb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.702617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.716483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599a8de-ac27-4b88-a561-9f1df7479947 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.740606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fc7c5-7514-4915-b184-8a474b7c077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.741221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fc7c5-7514-4915-b184-8a474b7c077a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.741499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fc7c5-7514-4915-b184-8a474b7c077a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.741770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fc7c5-7514-4915-b184-8a474b7c077a None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.742437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fc7c5-7514-4915-b184-8a474b7c077a None admin] RBAC: Adding query filter params (name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:29.742739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fc7c5-7514-4915-b184-8a474b7c077a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.744137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fc7c5-7514-4915-b184-8a474b7c077a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.754014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 390/809] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:29.762480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9577-4a19-4c8c-b618-d63b5e727305 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.762480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9577-4a19-4c8c-b618-d63b5e727305 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.762480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb9577-4a19-4c8c-b618-d63b5e727305 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.762480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 391/810] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:29.762480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb9577-4a19-4c8c-b618-d63b5e727305 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.762896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e47504-d7ae-4999-a2eb-e51a9915f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.763299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47504-d7ae-4999-a2eb-e51a9915f615 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.763568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47504-d7ae-4999-a2eb-e51a9915f615 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.763846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47504-d7ae-4999-a2eb-e51a9915f615 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.772145 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e47504-d7ae-4999-a2eb-e51a9915f615 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:29.773608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e47504-d7ae-4999-a2eb-e51a9915f615 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-10e47504-d7ae-4999-a2eb-e51a9915f615 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:29.786432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:29.787615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:29.788560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 420/811] 10.222.0.89 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:29.789179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9246584-1d0e-4034-b596-b67b210910b1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.789655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9246584-1d0e-4034-b596-b67b210910b1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.789750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9246584-1d0e-4034-b596-b67b210910b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.809141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b9246584-1d0e-4034-b596-b67b210910b1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:29.810556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b9246584-1d0e-4034-b596-b67b210910b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:29.882534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 421/812] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:29.883201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9246584-1d0e-4034-b596-b67b210910b1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:29.890495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb9577-4a19-4c8c-b618-d63b5e727305 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:29.909991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:29.979768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa279e-16e1-4403-b7d7-af44b35f0de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:29.980330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa279e-16e1-4403-b7d7-af44b35f0de2 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:29.980615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa279e-16e1-4403-b7d7-af44b35f0de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:29.980884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa279e-16e1-4403-b7d7-af44b35f0de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:29.991484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9246584-1d0e-4034-b596-b67b210910b1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.008031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa279e-16e1-4403-b7d7-af44b35f0de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.009500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa279e-16e1-4403-b7d7-af44b35f0de2 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.030721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18801ee5-8e35-4462-82d7-6cad916a7b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.031922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18801ee5-8e35-4462-82d7-6cad916a7b9f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.032205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18801ee5-8e35-4462-82d7-6cad916a7b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.032478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18801ee5-8e35-4462-82d7-6cad916a7b9f None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.033223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18801ee5-8e35-4462-82d7-6cad916a7b9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:30.033529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18801ee5-8e35-4462-82d7-6cad916a7b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.035100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18801ee5-8e35-4462-82d7-6cad916a7b9f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-d9aa279e-16e1-4403-b7d7-af44b35f0de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:30.041586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:30.042545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:30.043472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:30.043472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:30.043472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:30.047248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 392/813] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:30.050479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa279e-16e1-4403-b7d7-af44b35f0de2 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.059457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 422/814] 10.222.0.89 () {56 vars in 1133 bytes} [Fri Aug 26 15:27:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:30.065263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18801ee5-8e35-4462-82d7-6cad916a7b9f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.085929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.202409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.222953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa279e-16e1-4403-b7d7-af44b35f0de2 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.227509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18801ee5-8e35-4462-82d7-6cad916a7b9f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.262026 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8f457-89ed-4c7d-ab68-6ecac92df929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.262552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8f457-89ed-4c7d-ab68-6ecac92df929 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.262829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8f457-89ed-4c7d-ab68-6ecac92df929 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.263137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8f457-89ed-4c7d-ab68-6ecac92df929 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.263888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8f457-89ed-4c7d-ab68-6ecac92df929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:30.264195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8f457-89ed-4c7d-ab68-6ecac92df929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.266496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8f457-89ed-4c7d-ab68-6ecac92df929 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.277190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48540d08-bee3-4302-94ac-6a492c2a2bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.277970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48540d08-bee3-4302-94ac-6a492c2a2bbe None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.278245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48540d08-bee3-4302-94ac-6a492c2a2bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.278508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48540d08-bee3-4302-94ac-6a492c2a2bbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.280439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 393/815] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:30.281452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8f457-89ed-4c7d-ab68-6ecac92df929 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.347901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48540d08-bee3-4302-94ac-6a492c2a2bbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.349352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48540d08-bee3-4302-94ac-6a492c2a2bbe None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.364044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.391319 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8f457-89ed-4c7d-ab68-6ecac92df929 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.429466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3b58d-ce40-4c57-bc43-6e84391e3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.430445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3b58d-ce40-4c57-bc43-6e84391e3665 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.430864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3b58d-ce40-4c57-bc43-6e84391e3665 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.431289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3b58d-ce40-4c57-bc43-6e84391e3665 None admin] PATH_INFO: `/v3/services/network` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.432014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3b58d-ce40-4c57-bc43-6e84391e3665 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.433611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.434392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3b58d-ce40-4c57-bc43-6e84391e3665 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-b0b3b58d-ce40-4c57-bc43-6e84391e3665 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:30.444993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:30.446202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 15:27:30.447110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:30.449301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 394/816] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:30.450340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3b58d-ce40-4c57-bc43-6e84391e3665 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.459222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 423/817] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:30.460138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48540d08-bee3-4302-94ac-6a492c2a2bbe None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.564855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3b58d-ce40-4c57-bc43-6e84391e3665 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.601110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423a713-5b1b-4c74-a00d-3bc5a422de31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.602311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423a713-5b1b-4c74-a00d-3bc5a422de31 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.602791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423a713-5b1b-4c74-a00d-3bc5a422de31 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.603287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423a713-5b1b-4c74-a00d-3bc5a422de31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.607857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48540d08-bee3-4302-94ac-6a492c2a2bbe None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.612340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423a713-5b1b-4c74-a00d-3bc5a422de31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.614023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423a713-5b1b-4c74-a00d-3bc5a422de31 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.616980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-3423a713-5b1b-4c74-a00d-3bc5a422de31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:30.627627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:30.628568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:30.629469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:30.632044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 395/818] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:30.633077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423a713-5b1b-4c74-a00d-3bc5a422de31 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.664084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec868140-421b-4f7e-9926-eb8d618a3ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.664996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec868140-421b-4f7e-9926-eb8d618a3ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.665415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec868140-421b-4f7e-9926-eb8d618a3ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.665846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec868140-421b-4f7e-9926-eb8d618a3ab5 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.666819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec868140-421b-4f7e-9926-eb8d618a3ab5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:30.667326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec868140-421b-4f7e-9926-eb8d618a3ab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.669562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec868140-421b-4f7e-9926-eb8d618a3ab5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.677956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 424/819] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:30.679316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec868140-421b-4f7e-9926-eb8d618a3ab5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.744698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423a713-5b1b-4c74-a00d-3bc5a422de31 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.759931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.794858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b3cb4-2115-4b3c-b3d5-b750b2dafc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.795943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b3cb4-2115-4b3c-b3d5-b750b2dafc9b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.796451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b3cb4-2115-4b3c-b3d5-b750b2dafc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.797008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b3cb4-2115-4b3c-b3d5-b750b2dafc9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.809913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b3cb4-2115-4b3c-b3d5-b750b2dafc9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.811664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b3cb4-2115-4b3c-b3d5-b750b2dafc9b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-085b3cb4-2115-4b3c-b3d5-b750b2dafc9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:30.827216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:30.828191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:30.829095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:30.829095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:30.829095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:30.831130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 396/820] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:30.832098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b3cb4-2115-4b3c-b3d5-b750b2dafc9b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.834608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec868140-421b-4f7e-9926-eb8d618a3ab5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.882646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a840f4-0f76-4d85-b6a4-0a97f823540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.883399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a840f4-0f76-4d85-b6a4-0a97f823540f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.883682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a840f4-0f76-4d85-b6a4-0a97f823540f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.883993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a840f4-0f76-4d85-b6a4-0a97f823540f None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.885184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a840f4-0f76-4d85-b6a4-0a97f823540f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:30.885789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a840f4-0f76-4d85-b6a4-0a97f823540f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:30.887508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a840f4-0f76-4d85-b6a4-0a97f823540f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:30.892196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:30.914988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 425/821] 10.222.0.89 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:30.915545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a840f4-0f76-4d85-b6a4-0a97f823540f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:30.959497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b3cb4-2115-4b3c-b3d5-b750b2dafc9b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:30.997065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350a2df-3d98-41f7-83cd-64992a0b4e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:30.998076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350a2df-3d98-41f7-83cd-64992a0b4e09 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:30.998436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350a2df-3d98-41f7-83cd-64992a0b4e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:30.998899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350a2df-3d98-41f7-83cd-64992a0b4e09 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:30.999662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350a2df-3d98-41f7-83cd-64992a0b4e09 None admin] RBAC: Adding query filter params (type=network) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:31.000633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350a2df-3d98-41f7-83cd-64992a0b4e09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.002391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350a2df-3d98-41f7-83cd-64992a0b4e09 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.012755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 397/822] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:31.012755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350a2df-3d98-41f7-83cd-64992a0b4e09 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.071557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a840f4-0f76-4d85-b6a4-0a97f823540f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.075636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.126654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f57e8-1a1a-4d16-ada8-7bb91ef0befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.128249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f57e8-1a1a-4d16-ada8-7bb91ef0befc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f57e8-1a1a-4d16-ada8-7bb91ef0befc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.130189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f57e8-1a1a-4d16-ada8-7bb91ef0befc None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.131759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f57e8-1a1a-4d16-ada8-7bb91ef0befc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:31.132644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f57e8-1a1a-4d16-ada8-7bb91ef0befc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.134965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f57e8-1a1a-4d16-ada8-7bb91ef0befc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.136048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350a2df-3d98-41f7-83cd-64992a0b4e09 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.151536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 426/823] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:31.152231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f57e8-1a1a-4d16-ada8-7bb91ef0befc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.162115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.190022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c318b-6253-430e-999d-8402329f1a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.191074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c318b-6253-430e-999d-8402329f1a99 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.191837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c318b-6253-430e-999d-8402329f1a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.192364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c318b-6253-430e-999d-8402329f1a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.208873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c318b-6253-430e-999d-8402329f1a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.210511 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c318b-6253-430e-999d-8402329f1a99 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-de7c318b-6253-430e-999d-8402329f1a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:31.226604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:31.227639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:31.228539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:31.228539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:31.228539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:31.233216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 398/824] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:31.234075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c318b-6253-430e-999d-8402329f1a99 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.293486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f57e8-1a1a-4d16-ada8-7bb91ef0befc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.338370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba53e6-fcbf-4140-a66f-dcc6b24c1d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.339018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba53e6-fcbf-4140-a66f-dcc6b24c1d47 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.339350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba53e6-fcbf-4140-a66f-dcc6b24c1d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.339624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba53e6-fcbf-4140-a66f-dcc6b24c1d47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.340375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba53e6-fcbf-4140-a66f-dcc6b24c1d47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.342137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba53e6-fcbf-4140-a66f-dcc6b24c1d47 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.358121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c318b-6253-430e-999d-8402329f1a99 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.370969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 427/825] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:31 2022] POST /identity/v3/endpoints => generated 337 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:31.370969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba53e6-fcbf-4140-a66f-dcc6b24c1d47 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.401653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.419584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa5809-21c2-4a46-8259-830a02aa54aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.420319 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa5809-21c2-4a46-8259-830a02aa54aa None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.420610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa5809-21c2-4a46-8259-830a02aa54aa None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.421003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa5809-21c2-4a46-8259-830a02aa54aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.430715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa5809-21c2-4a46-8259-830a02aa54aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.432378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa5809-21c2-4a46-8259-830a02aa54aa None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-efaa5809-21c2-4a46-8259-830a02aa54aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:31.445272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:31.446983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:31.448190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:31.448190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:31.448190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:31.448190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:31.448190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:31.448190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:31.448190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:31.448190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:31.448190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 399/826] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:31.448932 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985abbdc-0c1a-4180-ac04-4f60fb45a091 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.448932 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985abbdc-0c1a-4180-ac04-4f60fb45a091 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.449162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985abbdc-0c1a-4180-ac04-4f60fb45a091 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.450620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 400/827] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:31.456174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985abbdc-0c1a-4180-ac04-4f60fb45a091 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.493261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.519518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba53e6-fcbf-4140-a66f-dcc6b24c1d47 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.566924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36100314-35e1-4ca1-a72a-42382cacd868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.567672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36100314-35e1-4ca1-a72a-42382cacd868 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.567954 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36100314-35e1-4ca1-a72a-42382cacd868 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.568225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36100314-35e1-4ca1-a72a-42382cacd868 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.569682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36100314-35e1-4ca1-a72a-42382cacd868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:31.569987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36100314-35e1-4ca1-a72a-42382cacd868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.571529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36100314-35e1-4ca1-a72a-42382cacd868 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.589445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 428/828] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:31.591966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330ecc1-2994-4d20-a340-330e76c147a4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.592467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330ecc1-2994-4d20-a340-330e76c147a4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.593115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330ecc1-2994-4d20-a340-330e76c147a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.608343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985abbdc-0c1a-4180-ac04-4f60fb45a091 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.616793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6330ecc1-2994-4d20-a340-330e76c147a4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:31.618522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6330ecc1-2994-4d20-a340-330e76c147a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:31.658987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5eda2-3d19-42e1-8768-421f4a9ae3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.659568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5eda2-3d19-42e1-8768-421f4a9ae3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.659881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5eda2-3d19-42e1-8768-421f4a9ae3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.660281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5eda2-3d19-42e1-8768-421f4a9ae3f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.661366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5eda2-3d19-42e1-8768-421f4a9ae3f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:31.661678 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5eda2-3d19-42e1-8768-421f4a9ae3f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.664018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5eda2-3d19-42e1-8768-421f4a9ae3f3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.679198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 401/829] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:31.679467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5eda2-3d19-42e1-8768-421f4a9ae3f3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.719143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 429/830] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:31.720043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330ecc1-2994-4d20-a340-330e76c147a4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.732720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.776589 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:31.804131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5eda2-3d19-42e1-8768-421f4a9ae3f3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.845958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330ecc1-2994-4d20-a340-330e76c147a4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:31.846493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee84f20-3c42-4435-b821-1e67b208bc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.847231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee84f20-3c42-4435-b821-1e67b208bc70 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.847516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee84f20-3c42-4435-b821-1e67b208bc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.847793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee84f20-3c42-4435-b821-1e67b208bc70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.854854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee84f20-3c42-4435-b821-1e67b208bc70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.856358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee84f20-3c42-4435-b821-1e67b208bc70 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-3ee84f20-3c42-4435-b821-1e67b208bc70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:31.868873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:31.869954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:31.870986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:31.870986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:31.870986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:31.870986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:31.870986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:31.870986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:31.870986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:31.870986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:31.870986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 402/831] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:31.871488 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4ce51-0e11-40c1-b3a6-5406cfa1ff4a None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.872189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4ce51-0e11-40c1-b3a6-5406cfa1ff4a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.872189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4ce51-0e11-40c1-b3a6-5406cfa1ff4a None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.878100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 403/832] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:31.878378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4ce51-0e11-40c1-b3a6-5406cfa1ff4a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:31.897941 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5c349-95ce-4adb-9d4a-7e301809d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:31.898564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c349-95ce-4adb-9d4a-7e301809d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.898848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c349-95ce-4adb-9d4a-7e301809d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.899147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5c349-95ce-4adb-9d4a-7e301809d0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.899901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5c349-95ce-4adb-9d4a-7e301809d0b3 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=5cbda75c38b04e6c89f17e655eb4f737) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:31.900209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5c349-95ce-4adb-9d4a-7e301809d0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:31.901684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5c349-95ce-4adb-9d4a-7e301809d0b3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:31.919440 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 430/833] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/role_assignments?user.id=5cbda75c38b04e6c89f17e655eb4f737&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=609b1a993a394f0e900e17edccebaea5 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:31.921369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180ebe-2377-4e4f-96fd-25c5247e9830 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:31.922292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180ebe-2377-4e4f-96fd-25c5247e9830 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:31.922669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180ebe-2377-4e4f-96fd-25c5247e9830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:31.949305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d3180ebe-2377-4e4f-96fd-25c5247e9830 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:31.951009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d3180ebe-2377-4e4f-96fd-25c5247e9830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:32.001341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4ce51-0e11-40c1-b3a6-5406cfa1ff4a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.033166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 431/834] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:32.034031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3180ebe-2377-4e4f-96fd-25c5247e9830 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.041188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.047232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbafd3-d4e8-48e4-8007-0f349174f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.048227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbafd3-d4e8-48e4-8007-0f349174f03a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.049191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbafd3-d4e8-48e4-8007-0f349174f03a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.049676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbafd3-d4e8-48e4-8007-0f349174f03a None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.051120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbafd3-d4e8-48e4-8007-0f349174f03a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:32.051540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbafd3-d4e8-48e4-8007-0f349174f03a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.053383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbafd3-d4e8-48e4-8007-0f349174f03a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.073575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 404/835] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:32.074480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbafd3-d4e8-48e4-8007-0f349174f03a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.078726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.177048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3180ebe-2377-4e4f-96fd-25c5247e9830 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.212864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbafd3-d4e8-48e4-8007-0f349174f03a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.220697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956536e9-37fb-4690-bf30-cc635c7dd2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.221344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956536e9-37fb-4690-bf30-cc635c7dd2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.221686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956536e9-37fb-4690-bf30-cc635c7dd2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.221963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956536e9-37fb-4690-bf30-cc635c7dd2a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.233970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956536e9-37fb-4690-bf30-cc635c7dd2a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-956536e9-37fb-4690-bf30-cc635c7dd2a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:32.239092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:32.240064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:32.240891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 432/836] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:32.248908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956536e9-37fb-4690-bf30-cc635c7dd2a1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.260426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b9030-c0b2-4176-9f9b-1b2bd6e1eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.262021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b9030-c0b2-4176-9f9b-1b2bd6e1eadf None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.262469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b9030-c0b2-4176-9f9b-1b2bd6e1eadf None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.263035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b9030-c0b2-4176-9f9b-1b2bd6e1eadf None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/b91335b29d0b43d5993c44a3e40d4a5b/roles/90c85626d318449cb55d5c2bc0b2e18d` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.286383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b9030-c0b2-4176-9f9b-1b2bd6e1eadf None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=b91335b29d0b43d5993c44a3e40d4a5b, role_id=90c85626d318449cb55d5c2bc0b2e18d)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.288937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b9030-c0b2-4176-9f9b-1b2bd6e1eadf None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.305942 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 405/837] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:32 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/b91335b29d0b43d5993c44a3e40d4a5b/roles/90c85626d318449cb55d5c2bc0b2e18d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:27:32.322215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b9030-c0b2-4176-9f9b-1b2bd6e1eadf None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.334987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.392657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956536e9-37fb-4690-bf30-cc635c7dd2a1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.395328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.439963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6cee-ecd4-4b36-a66f-b508748a6b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.440836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6cee-ecd4-4b36-a66f-b508748a6b10 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.441215 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6cee-ecd4-4b36-a66f-b508748a6b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.441586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6cee-ecd4-4b36-a66f-b508748a6b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.442817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed6cee-ecd4-4b36-a66f-b508748a6b10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:32.443483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed6cee-ecd4-4b36-a66f-b508748a6b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.445193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed6cee-ecd4-4b36-a66f-b508748a6b10 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.454122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b9030-c0b2-4176-9f9b-1b2bd6e1eadf None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.457482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 433/838] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:32.466133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6cee-ecd4-4b36-a66f-b508748a6b10 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.517901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e91f8a-fcb9-4542-9fe3-c8be85647efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.518564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e91f8a-fcb9-4542-9fe3-c8be85647efb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.519479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e91f8a-fcb9-4542-9fe3-c8be85647efb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.520106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e91f8a-fcb9-4542-9fe3-c8be85647efb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.520865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e91f8a-fcb9-4542-9fe3-c8be85647efb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.522821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e91f8a-fcb9-4542-9fe3-c8be85647efb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-68e91f8a-fcb9-4542-9fe3-c8be85647efb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:32.536162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:32.537323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:32.539684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 406/839] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:32.544909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e91f8a-fcb9-4542-9fe3-c8be85647efb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.606007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6cee-ecd4-4b36-a66f-b508748a6b10 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.635960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.651301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e7168-e788-49f3-a949-255de62d52f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.652029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e7168-e788-49f3-a949-255de62d52f7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.652311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e7168-e788-49f3-a949-255de62d52f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.652581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e7168-e788-49f3-a949-255de62d52f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.664530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e7168-e788-49f3-a949-255de62d52f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.666142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e7168-e788-49f3-a949-255de62d52f7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0e4e7168-e788-49f3-a949-255de62d52f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:32.682379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:32.683496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:32.684759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:32.684759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:32.684759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:32.684759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 434/840] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:32.690180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e7168-e788-49f3-a949-255de62d52f7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.699558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e91f8a-fcb9-4542-9fe3-c8be85647efb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.718836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.740510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d780d4-5f8e-4285-a67b-293a14f2552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.741491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d780d4-5f8e-4285-a67b-293a14f2552f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.742017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d780d4-5f8e-4285-a67b-293a14f2552f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.742516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d780d4-5f8e-4285-a67b-293a14f2552f None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.743489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d780d4-5f8e-4285-a67b-293a14f2552f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:32.744114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d780d4-5f8e-4285-a67b-293a14f2552f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.745990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d780d4-5f8e-4285-a67b-293a14f2552f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.751767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 407/841] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:32.756942 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d780d4-5f8e-4285-a67b-293a14f2552f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.816228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e7168-e788-49f3-a949-255de62d52f7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.855755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18710dc-d471-4f2d-af99-869211e27491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.856372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18710dc-d471-4f2d-af99-869211e27491 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.856652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18710dc-d471-4f2d-af99-869211e27491 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.856922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18710dc-d471-4f2d-af99-869211e27491 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.857570 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18710dc-d471-4f2d-af99-869211e27491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:32.857870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18710dc-d471-4f2d-af99-869211e27491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.859430 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18710dc-d471-4f2d-af99-869211e27491 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.870841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d780d4-5f8e-4285-a67b-293a14f2552f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:32.877834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 435/842] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:32.878759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18710dc-d471-4f2d-af99-869211e27491 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:32.912111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614c92b-62c1-4e6b-a4d3-e3cad59f20ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:32.912723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614c92b-62c1-4e6b-a4d3-e3cad59f20ce None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:32.913000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614c92b-62c1-4e6b-a4d3-e3cad59f20ce None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:32.913276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614c92b-62c1-4e6b-a4d3-e3cad59f20ce None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:32.913912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614c92b-62c1-4e6b-a4d3-e3cad59f20ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:32.914213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614c92b-62c1-4e6b-a4d3-e3cad59f20ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:32.915612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614c92b-62c1-4e6b-a4d3-e3cad59f20ce None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:32.920626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 408/843] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:32.936547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:32.998521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18710dc-d471-4f2d-af99-869211e27491 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.037756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf63ec-bf94-40f3-9f91-c3d76f882be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.038405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf63ec-bf94-40f3-9f91-c3d76f882be7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.038690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf63ec-bf94-40f3-9f91-c3d76f882be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.038994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf63ec-bf94-40f3-9f91-c3d76f882be7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.047292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf63ec-bf94-40f3-9f91-c3d76f882be7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.048948 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf63ec-bf94-40f3-9f91-c3d76f882be7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4aaf63ec-bf94-40f3-9f91-c3d76f882be7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:33.065008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:33.067318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:33.069462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 436/844] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:27:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:33.072734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614c92b-62c1-4e6b-a4d3-e3cad59f20ce None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.128518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.193293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614c92b-62c1-4e6b-a4d3-e3cad59f20ce None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.228094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734b542-fe2f-49a7-8b32-7976b5cedb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.228709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734b542-fe2f-49a7-8b32-7976b5cedb83 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.228993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734b542-fe2f-49a7-8b32-7976b5cedb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.229269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734b542-fe2f-49a7-8b32-7976b5cedb83 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.230005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734b542-fe2f-49a7-8b32-7976b5cedb83 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:33.230307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734b542-fe2f-49a7-8b32-7976b5cedb83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.231790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734b542-fe2f-49a7-8b32-7976b5cedb83 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.250816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 409/845] 10.222.0.89 () {56 vars in 1135 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:33.255960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf63ec-bf94-40f3-9f91-c3d76f882be7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.362099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf63ec-bf94-40f3-9f91-c3d76f882be7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.363667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.403417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bb677-5587-4ee9-89c6-f18b17dd21fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.404057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb677-5587-4ee9-89c6-f18b17dd21fc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.404287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb677-5587-4ee9-89c6-f18b17dd21fc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.404562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb677-5587-4ee9-89c6-f18b17dd21fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.486122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bb677-5587-4ee9-89c6-f18b17dd21fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.488020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bb677-5587-4ee9-89c6-f18b17dd21fc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.607439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.607675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 437/846] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:33.612797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734b542-fe2f-49a7-8b32-7976b5cedb83 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.716088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734b542-fe2f-49a7-8b32-7976b5cedb83 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.718978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:33.753183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def383e-a45e-4854-80a1-0b65d7fd7072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.753819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def383e-a45e-4854-80a1-0b65d7fd7072 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.754097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def383e-a45e-4854-80a1-0b65d7fd7072 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.754367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def383e-a45e-4854-80a1-0b65d7fd7072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.764612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def383e-a45e-4854-80a1-0b65d7fd7072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.766339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def383e-a45e-4854-80a1-0b65d7fd7072 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-2def383e-a45e-4854-80a1-0b65d7fd7072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:33.781685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:33.782637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:33.783544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:33.783544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:33.783544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:33.783544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 410/847] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:33.788421 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bb677-5587-4ee9-89c6-f18b17dd21fc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:33.901687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bb677-5587-4ee9-89c6-f18b17dd21fc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:33.937952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c1935-6b78-4926-9d72-4e07cd4eb5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:33.938565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c1935-6b78-4926-9d72-4e07cd4eb5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:33.938837 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c1935-6b78-4926-9d72-4e07cd4eb5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:33.939137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c1935-6b78-4926-9d72-4e07cd4eb5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:33.939779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c1935-6b78-4926-9d72-4e07cd4eb5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:33.940076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c1935-6b78-4926-9d72-4e07cd4eb5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:33.941433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c1935-6b78-4926-9d72-4e07cd4eb5f5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:33.954797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 438/848] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:33.960336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def383e-a45e-4854-80a1-0b65d7fd7072 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.081482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07e7e-ead5-432d-a1d9-8eef03c7a000 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.083565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07e7e-ead5-432d-a1d9-8eef03c7a000 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.083565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07e7e-ead5-432d-a1d9-8eef03c7a000 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.084328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 439/849] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:34.091162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def383e-a45e-4854-80a1-0b65d7fd7072 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.091662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b41f5-0223-4ab4-bbb0-3e01b6200087 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.092049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b41f5-0223-4ab4-bbb0-3e01b6200087 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.092423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b41f5-0223-4ab4-bbb0-3e01b6200087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.113191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-571b41f5-0223-4ab4-bbb0-3e01b6200087 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:34.114552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-571b41f5-0223-4ab4-bbb0-3e01b6200087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:34.131493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b741937-c8f0-4d30-8bc8-f6e1edf0f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.132372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b741937-c8f0-4d30-8bc8-f6e1edf0f193 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.132823 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b741937-c8f0-4d30-8bc8-f6e1edf0f193 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.133260 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b741937-c8f0-4d30-8bc8-f6e1edf0f193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.140685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b741937-c8f0-4d30-8bc8-f6e1edf0f193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.142317 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b741937-c8f0-4d30-8bc8-f6e1edf0f193 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-3b741937-c8f0-4d30-8bc8-f6e1edf0f193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:34.154042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:34.155337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:34.156552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:34.156552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:34.156552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:34.156552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:34.156552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:34.156552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:34.156552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:34.156552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:34.158595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 411/850] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:34.167907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b741937-c8f0-4d30-8bc8-f6e1edf0f193 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.176009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.195181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 440/851] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:34.196176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.292829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b741937-c8f0-4d30-8bc8-f6e1edf0f193 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.332479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8198ae-8690-4b31-a4d3-e995e7a4151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.333493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8198ae-8690-4b31-a4d3-e995e7a4151c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.334003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8198ae-8690-4b31-a4d3-e995e7a4151c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.334484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8198ae-8690-4b31-a4d3-e995e7a4151c None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.335441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8198ae-8690-4b31-a4d3-e995e7a4151c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:34.335961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8198ae-8690-4b31-a4d3-e995e7a4151c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.337615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8198ae-8690-4b31-a4d3-e995e7a4151c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.351429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 412/852] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:34.357668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b41f5-0223-4ab4-bbb0-3e01b6200087 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.428820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28488a15-7159-4321-832f-3cfce631cb4b None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.429006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28488a15-7159-4321-832f-3cfce631cb4b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.429282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28488a15-7159-4321-832f-3cfce631cb4b None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.430753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 413/853] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:34.435918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f8db-ab47-49a1-b8ed-f97a878213f8 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.436201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f8db-ab47-49a1-b8ed-f97a878213f8 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.436475 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f8db-ab47-49a1-b8ed-f97a878213f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.455879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7302f8db-ab47-49a1-b8ed-f97a878213f8 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:34.457096 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7302f8db-ab47-49a1-b8ed-f97a878213f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:34.485499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b41f5-0223-4ab4-bbb0-3e01b6200087 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.528432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05f70c-9d5f-48c6-8594-29d395cafaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.529347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05f70c-9d5f-48c6-8594-29d395cafaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.529789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05f70c-9d5f-48c6-8594-29d395cafaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.530335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05f70c-9d5f-48c6-8594-29d395cafaf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.531884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05f70c-9d5f-48c6-8594-29d395cafaf6 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=9df361aabe544b618c7c1c1d98b8751a) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:34.532354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05f70c-9d5f-48c6-8594-29d395cafaf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.532955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 414/854] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:34.534110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05f70c-9d5f-48c6-8594-29d395cafaf6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.535377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302f8db-ab47-49a1-b8ed-f97a878213f8 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.544875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.551698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 441/855] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/role_assignments?user.id=9df361aabe544b618c7c1c1d98b8751a&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=609b1a993a394f0e900e17edccebaea5 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:34.652648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302f8db-ab47-49a1-b8ed-f97a878213f8 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.690728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66566e95-2311-4751-bdd3-50c620f5a07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.691336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66566e95-2311-4751-bdd3-50c620f5a07f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.691618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66566e95-2311-4751-bdd3-50c620f5a07f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.691896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66566e95-2311-4751-bdd3-50c620f5a07f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.692504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66566e95-2311-4751-bdd3-50c620f5a07f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.693907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66566e95-2311-4751-bdd3-50c620f5a07f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-66566e95-2311-4751-bdd3-50c620f5a07f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:34.703521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:34.704542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:34.705452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 415/856] 10.222.0.89 () {56 vars in 1132 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:34.710801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05f70c-9d5f-48c6-8594-29d395cafaf6 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.768310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.812673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66566e95-2311-4751-bdd3-50c620f5a07f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.833598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05f70c-9d5f-48c6-8594-29d395cafaf6 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.869550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c470687-1420-4e21-81c2-fd7dcd394bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.870535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470687-1420-4e21-81c2-fd7dcd394bbc None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.871052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470687-1420-4e21-81c2-fd7dcd394bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.871578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470687-1420-4e21-81c2-fd7dcd394bbc None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.872501 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c470687-1420-4e21-81c2-fd7dcd394bbc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:34.872997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c470687-1420-4e21-81c2-fd7dcd394bbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:34.875313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c470687-1420-4e21-81c2-fd7dcd394bbc None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:34.880764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 442/857] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:34.887539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c470687-1420-4e21-81c2-fd7dcd394bbc None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:34.891852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:34.928778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66566e95-2311-4751-bdd3-50c620f5a07f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:34.969016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af772b7-245e-4b1e-bc51-d55289ead0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:34.969576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af772b7-245e-4b1e-bc51-d55289ead0ff None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:34.969878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af772b7-245e-4b1e-bc51-d55289ead0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:34.970224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af772b7-245e-4b1e-bc51-d55289ead0ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:34.981491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af772b7-245e-4b1e-bc51-d55289ead0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-0af772b7-245e-4b1e-bc51-d55289ead0ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:34.987133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:34.988081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:27:34.988925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:34.993167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 416/858] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:34.994458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af772b7-245e-4b1e-bc51-d55289ead0ff None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.005619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c470687-1420-4e21-81c2-fd7dcd394bbc None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.023447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.042946 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b592e6-6867-48d8-a0f0-df9b71e64bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.043578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b592e6-6867-48d8-a0f0-df9b71e64bbd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.043858 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b592e6-6867-48d8-a0f0-df9b71e64bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.044131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b592e6-6867-48d8-a0f0-df9b71e64bbd None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.044765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b592e6-6867-48d8-a0f0-df9b71e64bbd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:35.045151 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b592e6-6867-48d8-a0f0-df9b71e64bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.047052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b592e6-6867-48d8-a0f0-df9b71e64bbd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.055706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 443/859] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:35.055706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021a98-da03-4993-bc86-70b0bfa36d53 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.055706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021a98-da03-4993-bc86-70b0bfa36d53 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.055706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021a98-da03-4993-bc86-70b0bfa36d53 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.055706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 444/860] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:35.060215 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38c5c8-9601-4462-8636-289d7da941d2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.060744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38c5c8-9601-4462-8636-289d7da941d2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.061961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38c5c8-9601-4462-8636-289d7da941d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.081711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5f38c5c8-9601-4462-8636-289d7da941d2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:35.083069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5f38c5c8-9601-4462-8636-289d7da941d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:35.116913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af772b7-245e-4b1e-bc51-d55289ead0ff None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.158850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.165923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d37fa-22c7-41d0-8c25-8611207e7468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.166741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d37fa-22c7-41d0-8c25-8611207e7468 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.167208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d37fa-22c7-41d0-8c25-8611207e7468 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.167584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d37fa-22c7-41d0-8c25-8611207e7468 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.168474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d37fa-22c7-41d0-8c25-8611207e7468 None admin] RBAC: Adding query filter params (name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:35.168884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d37fa-22c7-41d0-8c25-8611207e7468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.170397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d37fa-22c7-41d0-8c25-8611207e7468 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.175219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 445/861] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:35.184570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 417/862] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:27:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:35.190500 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38c5c8-9601-4462-8636-289d7da941d2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.298439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38c5c8-9601-4462-8636-289d7da941d2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.311061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.336751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e046d-44cb-4cd2-9ad2-d1756bd7b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.337389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e046d-44cb-4cd2-9ad2-d1756bd7b3ef None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.337667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e046d-44cb-4cd2-9ad2-d1756bd7b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.337937 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e046d-44cb-4cd2-9ad2-d1756bd7b3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.349027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e046d-44cb-4cd2-9ad2-d1756bd7b3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.350468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e046d-44cb-4cd2-9ad2-d1756bd7b3ef None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0f7e046d-44cb-4cd2-9ad2-d1756bd7b3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:35.368680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:35.369631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:35.371019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:35.371019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:35.371019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:35.371019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 446/863] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:35.377737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d37fa-22c7-41d0-8c25-8611207e7468 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.458308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e046d-44cb-4cd2-9ad2-d1756bd7b3ef None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.497153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d37fa-22c7-41d0-8c25-8611207e7468 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.537958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537e13e-b325-48a9-ba77-f5f8ad7ced43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.539106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537e13e-b325-48a9-ba77-f5f8ad7ced43 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.539617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537e13e-b325-48a9-ba77-f5f8ad7ced43 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.540100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537e13e-b325-48a9-ba77-f5f8ad7ced43 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.540954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537e13e-b325-48a9-ba77-f5f8ad7ced43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:35.541730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537e13e-b325-48a9-ba77-f5f8ad7ced43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.543357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537e13e-b325-48a9-ba77-f5f8ad7ced43 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.557646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 418/864] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:35.566067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537e13e-b325-48a9-ba77-f5f8ad7ced43 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.597611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e046d-44cb-4cd2-9ad2-d1756bd7b3ef None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.631415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.660115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dedcf8-6801-4427-b6ca-1f6143b7b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.661122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dedcf8-6801-4427-b6ca-1f6143b7b069 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.661846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dedcf8-6801-4427-b6ca-1f6143b7b069 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.662244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dedcf8-6801-4427-b6ca-1f6143b7b069 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.663337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dedcf8-6801-4427-b6ca-1f6143b7b069 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.664734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dedcf8-6801-4427-b6ca-1f6143b7b069 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.685249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 447/865] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:35 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:35.694137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537e13e-b325-48a9-ba77-f5f8ad7ced43 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.748384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbca9ff-976b-45fc-b353-7dabfd55ff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.749072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbca9ff-976b-45fc-b353-7dabfd55ff7b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.750970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbca9ff-976b-45fc-b353-7dabfd55ff7b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.750970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbca9ff-976b-45fc-b353-7dabfd55ff7b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.759343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbca9ff-976b-45fc-b353-7dabfd55ff7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.760849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbca9ff-976b-45fc-b353-7dabfd55ff7b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-ecbca9ff-976b-45fc-b353-7dabfd55ff7b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:35.774112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:35.775428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:35.776367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 419/866] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:35.784142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dedcf8-6801-4427-b6ca-1f6143b7b069 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:35.829114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:35.915847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dedcf8-6801-4427-b6ca-1f6143b7b069 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:35.951395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eaa74-d900-464f-a80f-6c0c808e98d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:35.952367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eaa74-d900-464f-a80f-6c0c808e98d1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:35.953432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eaa74-d900-464f-a80f-6c0c808e98d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:35.953969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eaa74-d900-464f-a80f-6c0c808e98d1 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:35.954958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0eaa74-d900-464f-a80f-6c0c808e98d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:35.955465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0eaa74-d900-464f-a80f-6c0c808e98d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:35.957190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0eaa74-d900-464f-a80f-6c0c808e98d1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:35.974928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 448/867] 10.222.0.89 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:35.982957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbca9ff-976b-45fc-b353-7dabfd55ff7b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.083167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbca9ff-976b-45fc-b353-7dabfd55ff7b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.092302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:36.123232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f470-c176-40e7-9e4a-ee40aabcdb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.123867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f470-c176-40e7-9e4a-ee40aabcdb94 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.124168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f470-c176-40e7-9e4a-ee40aabcdb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.124443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f470-c176-40e7-9e4a-ee40aabcdb94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.194798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f470-c176-40e7-9e4a-ee40aabcdb94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.196345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f470-c176-40e7-9e4a-ee40aabcdb94 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:36.304272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 420/868] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:35 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:36.309698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eaa74-d900-464f-a80f-6c0c808e98d1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.395728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:36.417056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eaa74-d900-464f-a80f-6c0c808e98d1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.453814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db29de-ba6d-4edd-8526-6a489e10ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.454444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db29de-ba6d-4edd-8526-6a489e10ff07 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.454720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db29de-ba6d-4edd-8526-6a489e10ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.455010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db29de-ba6d-4edd-8526-6a489e10ff07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.465602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db29de-ba6d-4edd-8526-6a489e10ff07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.467066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db29de-ba6d-4edd-8526-6a489e10ff07 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f2db29de-ba6d-4edd-8526-6a489e10ff07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:36.481988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:36.482926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:36.483845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:36.483845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:36.483845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:36.488398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 449/869] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:36.489739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f470-c176-40e7-9e4a-ee40aabcdb94 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.512408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:36.598336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f470-c176-40e7-9e4a-ee40aabcdb94 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.633868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47430636-7f24-4fb7-8941-c5e8ed763078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.634480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47430636-7f24-4fb7-8941-c5e8ed763078 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.634758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47430636-7f24-4fb7-8941-c5e8ed763078 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.635057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47430636-7f24-4fb7-8941-c5e8ed763078 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.635707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47430636-7f24-4fb7-8941-c5e8ed763078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:36.636010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47430636-7f24-4fb7-8941-c5e8ed763078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.637375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47430636-7f24-4fb7-8941-c5e8ed763078 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:36.649695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 421/870] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:36.656812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db29de-ba6d-4edd-8526-6a489e10ff07 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.726270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07672-f731-42f9-b137-c6a818d53d0f None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.726816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07672-f731-42f9-b137-c6a818d53d0f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.727112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07672-f731-42f9-b137-c6a818d53d0f None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.728816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 422/871] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:36.734245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5abd2-4c22-4330-b77f-562a21d36f04 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.734667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5abd2-4c22-4330-b77f-562a21d36f04 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.735084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5abd2-4c22-4330-b77f-562a21d36f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.754680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-a6c5abd2-4c22-4330-b77f-562a21d36f04 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:36.756129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a6c5abd2-4c22-4330-b77f-562a21d36f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:36.763778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db29de-ba6d-4edd-8526-6a489e10ff07 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.794437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:36.799601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baf1d6-e8d8-43b3-bad1-af16180f66ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.800667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baf1d6-e8d8-43b3-bad1-af16180f66ae None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.800987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baf1d6-e8d8-43b3-bad1-af16180f66ae None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.801385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baf1d6-e8d8-43b3-bad1-af16180f66ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.809343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baf1d6-e8d8-43b3-bad1-af16180f66ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.810802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baf1d6-e8d8-43b3-bad1-af16180f66ae None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-89baf1d6-e8d8-43b3-bad1-af16180f66ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:36.823239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:36.824166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:36.825113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:36.825113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:36.825113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:36.825113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:36.825113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:36.825113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:36.825113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:36.825113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:36.829840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 450/872] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:36.831098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baf1d6-e8d8-43b3-bad1-af16180f66ae None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:36.843434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:36.847036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 423/873] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:36.955419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baf1d6-e8d8-43b3-bad1-af16180f66ae None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:36.992224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899def1-a418-435b-a707-e4ed707a1b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:36.992840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899def1-a418-435b-a707-e4ed707a1b90 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:36.993116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899def1-a418-435b-a707-e4ed707a1b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:36.993386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899def1-a418-435b-a707-e4ed707a1b90 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:36.994075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899def1-a418-435b-a707-e4ed707a1b90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:36.994452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899def1-a418-435b-a707-e4ed707a1b90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:36.995969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899def1-a418-435b-a707-e4ed707a1b90 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.014828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 451/874] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:37.017068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5abd2-4c22-4330-b77f-562a21d36f04 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.131309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5abd2-4c22-4330-b77f-562a21d36f04 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.161638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33cd90-ab4e-4231-a2b2-c3c190c19389 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.162277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33cd90-ab4e-4231-a2b2-c3c190c19389 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.162764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33cd90-ab4e-4231-a2b2-c3c190c19389 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.164663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 452/875] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:37.169659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e42b8a-1e88-4380-bac7-db4e095d0b03 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.169948 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e42b8a-1e88-4380-bac7-db4e095d0b03 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.170229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e42b8a-1e88-4380-bac7-db4e095d0b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.176427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925adbc-98c9-40dc-88e9-d6b046065177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.177356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925adbc-98c9-40dc-88e9-d6b046065177 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.178059 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925adbc-98c9-40dc-88e9-d6b046065177 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.179337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925adbc-98c9-40dc-88e9-d6b046065177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.184211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925adbc-98c9-40dc-88e9-d6b046065177 None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=b91335b29d0b43d5993c44a3e40d4a5b) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:37.184761 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925adbc-98c9-40dc-88e9-d6b046065177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.186737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925adbc-98c9-40dc-88e9-d6b046065177 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.190147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-43e42b8a-1e88-4380-bac7-db4e095d0b03 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:37.191483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-43e42b8a-1e88-4380-bac7-db4e095d0b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:37.202124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 424/876] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:37 2022] GET /identity/v3/role_assignments?user.id=b91335b29d0b43d5993c44a3e40d4a5b&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:37.203963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925adbc-98c9-40dc-88e9-d6b046065177 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.260629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:37.293324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:37.297060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 453/877] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:37.351376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925adbc-98c9-40dc-88e9-d6b046065177 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.393722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e844-1c08-4e23-8385-415099ca82f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.394362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e844-1c08-4e23-8385-415099ca82f0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.394646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e844-1c08-4e23-8385-415099ca82f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.394918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e844-1c08-4e23-8385-415099ca82f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.395540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7e844-1c08-4e23-8385-415099ca82f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.397025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7e844-1c08-4e23-8385-415099ca82f0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-6ef7e844-1c08-4e23-8385-415099ca82f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:37.406249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:37.407378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:37.408830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 425/878] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:37.413681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e42b8a-1e88-4380-bac7-db4e095d0b03 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.523763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e42b8a-1e88-4380-bac7-db4e095d0b03 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.560586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504d966-b162-40d6-aa29-97f20e1d7f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.561199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504d966-b162-40d6-aa29-97f20e1d7f3f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.561478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504d966-b162-40d6-aa29-97f20e1d7f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.561750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504d966-b162-40d6-aa29-97f20e1d7f3f None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.562961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504d966-b162-40d6-aa29-97f20e1d7f3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:37.563265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504d966-b162-40d6-aa29-97f20e1d7f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.564636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504d966-b162-40d6-aa29-97f20e1d7f3f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.569796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 454/879] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:37.575448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e844-1c08-4e23-8385-415099ca82f0 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.587256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504d966-b162-40d6-aa29-97f20e1d7f3f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:37.675381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:37.689614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e844-1c08-4e23-8385-415099ca82f0 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.717984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:37.728090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504d966-b162-40d6-aa29-97f20e1d7f3f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:37.729317 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd20bd-5f3b-481a-95e9-b7e33e5d8222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.730473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd20bd-5f3b-481a-95e9-b7e33e5d8222 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.730918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd20bd-5f3b-481a-95e9-b7e33e5d8222 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.731444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd20bd-5f3b-481a-95e9-b7e33e5d8222 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.732290 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd20bd-5f3b-481a-95e9-b7e33e5d8222 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:37.732801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd20bd-5f3b-481a-95e9-b7e33e5d8222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.735003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd20bd-5f3b-481a-95e9-b7e33e5d8222 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.740572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 426/880] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:37.742182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd44aba-c2c9-4456-9f3e-970f34239995 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.742672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd44aba-c2c9-4456-9f3e-970f34239995 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.743160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd44aba-c2c9-4456-9f3e-970f34239995 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.744927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 427/881] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:37.752817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6365-a5dd-40a7-a627-a3bda423ee47 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.753443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6365-a5dd-40a7-a627-a3bda423ee47 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.753921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6365-a5dd-40a7-a627-a3bda423ee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.775266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-bc6d6365-a5dd-40a7-a627-a3bda423ee47 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:37.775499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35aae8-6d91-4cb7-b95f-a39676d7a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:37.776958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bc6d6365-a5dd-40a7-a627-a3bda423ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:37.784066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35aae8-6d91-4cb7-b95f-a39676d7a92b None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:37.784361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35aae8-6d91-4cb7-b95f-a39676d7a92b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:37.784826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35aae8-6d91-4cb7-b95f-a39676d7a92b None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:37.785699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35aae8-6d91-4cb7-b95f-a39676d7a92b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:37.787295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35aae8-6d91-4cb7-b95f-a39676d7a92b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:37.820146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 455/882] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:37 2022] POST /identity/v3/services => generated 269 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:37.882780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 428/883] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:38.163851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35aae8-6d91-4cb7-b95f-a39676d7a92b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.308249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35aae8-6d91-4cb7-b95f-a39676d7a92b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.319273 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:38.363404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5236-14dd-44e7-9005-1b0a8fdebe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.364435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5236-14dd-44e7-9005-1b0a8fdebe0f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.365050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5236-14dd-44e7-9005-1b0a8fdebe0f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.365682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5236-14dd-44e7-9005-1b0a8fdebe0f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.366476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb5236-14dd-44e7-9005-1b0a8fdebe0f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.368818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb5236-14dd-44e7-9005-1b0a8fdebe0f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-90fb5236-14dd-44e7-9005-1b0a8fdebe0f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:38.381084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:38.382111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:38.382928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:38.385996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 456/884] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:38.393570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d6365-a5dd-40a7-a627-a3bda423ee47 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.527609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d6365-a5dd-40a7-a627-a3bda423ee47 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.563314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:38.569639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0390-05ef-405a-88c8-0a563480b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.570628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0390-05ef-405a-88c8-0a563480b82e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.571540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0390-05ef-405a-88c8-0a563480b82e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.572013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0390-05ef-405a-88c8-0a563480b82e None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.572934 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0390-05ef-405a-88c8-0a563480b82e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:38.573430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0390-05ef-405a-88c8-0a563480b82e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.575039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0390-05ef-405a-88c8-0a563480b82e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.580983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 429/885] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:38.586828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5236-14dd-44e7-9005-1b0a8fdebe0f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.742916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5236-14dd-44e7-9005-1b0a8fdebe0f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.779845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbfbf2-9f5c-4ea8-9a66-8c87715d1281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.780698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbfbf2-9f5c-4ea8-9a66-8c87715d1281 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.781201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbfbf2-9f5c-4ea8-9a66-8c87715d1281 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.781621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbfbf2-9f5c-4ea8-9a66-8c87715d1281 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.782417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbfbf2-9f5c-4ea8-9a66-8c87715d1281 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:38.782881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbfbf2-9f5c-4ea8-9a66-8c87715d1281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.784427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbfbf2-9f5c-4ea8-9a66-8c87715d1281 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.790657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 457/886] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:38.798367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0390-05ef-405a-88c8-0a563480b82e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:38.909590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0390-05ef-405a-88c8-0a563480b82e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:38.948052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585602db-b115-45f3-9a67-f68e00b82b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:38.949050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585602db-b115-45f3-9a67-f68e00b82b95 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:38.949536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585602db-b115-45f3-9a67-f68e00b82b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:38.949959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585602db-b115-45f3-9a67-f68e00b82b95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:38.950863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585602db-b115-45f3-9a67-f68e00b82b95 None admin] RBAC: Adding query filter params (interface=public, service_id=d6e7a22425f04537acb97c36b763330a, region_id=RegionOne) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:38.951344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585602db-b115-45f3-9a67-f68e00b82b95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:38.953525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585602db-b115-45f3-9a67-f68e00b82b95 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:38.959705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 430/887] 10.222.0.89 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/endpoints?service_id=d6e7a22425f04537acb97c36b763330a&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:38.965616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbfbf2-9f5c-4ea8-9a66-8c87715d1281 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:39.004164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:39.078271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbfbf2-9f5c-4ea8-9a66-8c87715d1281 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:39.115575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fe6c2-0758-4f71-95d8-3d4738459753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:39.116469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe6c2-0758-4f71-95d8-3d4738459753 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.116966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe6c2-0758-4f71-95d8-3d4738459753 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.117407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fe6c2-0758-4f71-95d8-3d4738459753 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.118242 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe6c2-0758-4f71-95d8-3d4738459753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:39.119774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fe6c2-0758-4f71-95d8-3d4738459753 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:39.127254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 458/888] 10.222.0.89 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:38 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:27:39.514418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4e56e-95ac-47c6-a1d1-6f3ea8d3a98c None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.514611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4e56e-95ac-47c6-a1d1-6f3ea8d3a98c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.514888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4e56e-95ac-47c6-a1d1-6f3ea8d3a98c None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.516816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 431/889] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:39.522128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3bdef-b6e2-4fa6-97c6-3c842c062833 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.522416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3bdef-b6e2-4fa6-97c6-3c842c062833 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.522690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3bdef-b6e2-4fa6-97c6-3c842c062833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.541982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ced3bdef-b6e2-4fa6-97c6-3c842c062833 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:39.543198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ced3bdef-b6e2-4fa6-97c6-3c842c062833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:39.616678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 459/890] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:39.844700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dc99-ae84-4ee8-aab9-829bda836b70 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.845264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dc99-ae84-4ee8-aab9-829bda836b70 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.845264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164dc99-ae84-4ee8-aab9-829bda836b70 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.846816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 432/891] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:39.852498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b004f-71b3-4ecc-bdf3-25cba0c68873 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.853373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b004f-71b3-4ecc-bdf3-25cba0c68873 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.853862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b004f-71b3-4ecc-bdf3-25cba0c68873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.873239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fd7b004f-71b3-4ecc-bdf3-25cba0c68873 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:39.874905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fd7b004f-71b3-4ecc-bdf3-25cba0c68873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:39.899643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:39.914970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075c9ea-7f2a-470b-9bba-1c8132ee65b3 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.914970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075c9ea-7f2a-470b-9bba-1c8132ee65b3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.915635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075c9ea-7f2a-470b-9bba-1c8132ee65b3 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.917401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 433/892] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:39.923363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9b7cf-3029-40a4-afd6-66d3fd3cbc70 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:39.923922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9b7cf-3029-40a4-afd6-66d3fd3cbc70 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:39.924396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9b7cf-3029-40a4-afd6-66d3fd3cbc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:39.943385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-2cc9b7cf-3029-40a4-afd6-66d3fd3cbc70 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:39.944677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2cc9b7cf-3029-40a4-afd6-66d3fd3cbc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:39.950255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 460/893] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:39.951018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b004f-71b3-4ecc-bdf3-25cba0c68873 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:39.995847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.028501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 434/894] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:40.055025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b004f-71b3-4ecc-bdf3-25cba0c68873 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.090141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3074509-9fd6-4644-8433-ecbecc16567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.090774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3074509-9fd6-4644-8433-ecbecc16567c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.091084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3074509-9fd6-4644-8433-ecbecc16567c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.091354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3074509-9fd6-4644-8433-ecbecc16567c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.103518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3074509-9fd6-4644-8433-ecbecc16567c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-f3074509-9fd6-4644-8433-ecbecc16567c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:40.108416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:40.109403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:40.110217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 461/895] 10.222.0.89 () {56 vars in 1120 bytes} [Fri Aug 26 15:27:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:40.117620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9b7cf-3029-40a4-afd6-66d3fd3cbc70 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.220301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3074509-9fd6-4644-8433-ecbecc16567c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.226449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9b7cf-3029-40a4-afd6-66d3fd3cbc70 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.243827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.269517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efd69c-3c17-48e5-8749-929eb9d82175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.270579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efd69c-3c17-48e5-8749-929eb9d82175 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.271126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efd69c-3c17-48e5-8749-929eb9d82175 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.271605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efd69c-3c17-48e5-8749-929eb9d82175 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.272541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efd69c-3c17-48e5-8749-929eb9d82175 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:40.273053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efd69c-3c17-48e5-8749-929eb9d82175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.274833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efd69c-3c17-48e5-8749-929eb9d82175 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.285300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 435/896] 10.222.0.89 () {56 vars in 1115 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:40.291060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efd69c-3c17-48e5-8749-929eb9d82175 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.336707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.355510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3074509-9fd6-4644-8433-ecbecc16567c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.391380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdd743-3d99-4c10-bb7e-c1e0a2f98353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.391986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdd743-3d99-4c10-bb7e-c1e0a2f98353 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.392264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdd743-3d99-4c10-bb7e-c1e0a2f98353 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.392528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdd743-3d99-4c10-bb7e-c1e0a2f98353 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.393179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdd743-3d99-4c10-bb7e-c1e0a2f98353 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.394531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdd743-3d99-4c10-bb7e-c1e0a2f98353 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.419441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 462/897] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:40 2022] POST /identity/v3/services => generated 241 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:40.420436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdd743-3d99-4c10-bb7e-c1e0a2f98353 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.420635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efd69c-3c17-48e5-8749-929eb9d82175 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.481154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a325be-55ff-4e02-98f0-868f5ced3d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.481800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a325be-55ff-4e02-98f0-868f5ced3d3e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.482077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a325be-55ff-4e02-98f0-868f5ced3d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.482348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a325be-55ff-4e02-98f0-868f5ced3d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.497202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a325be-55ff-4e02-98f0-868f5ced3d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.498695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a325be-55ff-4e02-98f0-868f5ced3d3e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-09a325be-55ff-4e02-98f0-868f5ced3d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:40.521094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:40.522108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:40.523020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:40.523020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:40.523020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:40.527105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 436/898] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:40.529305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a325be-55ff-4e02-98f0-868f5ced3d3e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.553745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.592681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdd743-3d99-4c10-bb7e-c1e0a2f98353 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.636667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.638621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9784607-2957-40bc-a223-c1c84a9ff1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.641175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784607-2957-40bc-a223-c1c84a9ff1fb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.641175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784607-2957-40bc-a223-c1c84a9ff1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.641175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784607-2957-40bc-a223-c1c84a9ff1fb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.641632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9784607-2957-40bc-a223-c1c84a9ff1fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.643260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9784607-2957-40bc-a223-c1c84a9ff1fb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-b9784607-2957-40bc-a223-c1c84a9ff1fb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:40.654438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:40.655450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:40.656516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:40.659568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 463/899] 10.222.0.89 () {56 vars in 1132 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:40.664027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a325be-55ff-4e02-98f0-868f5ced3d3e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.666724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9784607-2957-40bc-a223-c1c84a9ff1fb None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.711412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015a1fb-3416-4b6e-902f-d0155c6c0bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.712449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015a1fb-3416-4b6e-902f-d0155c6c0bba None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.712933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015a1fb-3416-4b6e-902f-d0155c6c0bba None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.713399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015a1fb-3416-4b6e-902f-d0155c6c0bba None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.714669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015a1fb-3416-4b6e-902f-d0155c6c0bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:40.715204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015a1fb-3416-4b6e-902f-d0155c6c0bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.717137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015a1fb-3416-4b6e-902f-d0155c6c0bba None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.738966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 437/900] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:40.740663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015a1fb-3416-4b6e-902f-d0155c6c0bba None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.798677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9784607-2957-40bc-a223-c1c84a9ff1fb None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.836621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea21da1-3930-47fb-a4b2-43c58ebae0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.837255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea21da1-3930-47fb-a4b2-43c58ebae0fd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.837551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea21da1-3930-47fb-a4b2-43c58ebae0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.837833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea21da1-3930-47fb-a4b2-43c58ebae0fd None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.838513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea21da1-3930-47fb-a4b2-43c58ebae0fd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:40.838825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea21da1-3930-47fb-a4b2-43c58ebae0fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.840467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea21da1-3930-47fb-a4b2-43c58ebae0fd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.851012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 464/901] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:40.853615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea21da1-3930-47fb-a4b2-43c58ebae0fd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.864797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015a1fb-3416-4b6e-902f-d0155c6c0bba None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:40.868670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.907413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f87fa-15cf-4089-9895-3bdfd9851775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:40.908173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f87fa-15cf-4089-9895-3bdfd9851775 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:40.908524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f87fa-15cf-4089-9895-3bdfd9851775 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:40.908875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f87fa-15cf-4089-9895-3bdfd9851775 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:40.917345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f87fa-15cf-4089-9895-3bdfd9851775 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:40.919348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f87fa-15cf-4089-9895-3bdfd9851775 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-7b6f87fa-15cf-4089-9895-3bdfd9851775 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:40.932119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:40.933091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:40.933992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:40.938294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 438/902] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:40.939389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f87fa-15cf-4089-9895-3bdfd9851775 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:40.944299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:40.991452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea21da1-3930-47fb-a4b2-43c58ebae0fd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.035287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d4d5a-f640-4f73-8af0-0acae6164923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.036355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4d5a-f640-4f73-8af0-0acae6164923 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.036811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4d5a-f640-4f73-8af0-0acae6164923 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.037530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4d5a-f640-4f73-8af0-0acae6164923 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.038376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d4d5a-f640-4f73-8af0-0acae6164923 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:41.038855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d4d5a-f640-4f73-8af0-0acae6164923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.040872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d4d5a-f640-4f73-8af0-0acae6164923 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.048301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 465/903] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:41.053790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d4d5a-f640-4f73-8af0-0acae6164923 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.058112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f87fa-15cf-4089-9895-3bdfd9851775 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.096445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36b1cf-e5d7-492a-8ecf-068950290079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.097355 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b1cf-e5d7-492a-8ecf-068950290079 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.097689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b1cf-e5d7-492a-8ecf-068950290079 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.097964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36b1cf-e5d7-492a-8ecf-068950290079 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.098709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b1cf-e5d7-492a-8ecf-068950290079 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:41.099051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b1cf-e5d7-492a-8ecf-068950290079 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.100495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36b1cf-e5d7-492a-8ecf-068950290079 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.118881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 439/904] 10.222.0.89 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:41.120095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb256f-b922-444d-bd3b-bcf2942445ef None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.120494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb256f-b922-444d-bd3b-bcf2942445ef None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.120969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb256f-b922-444d-bd3b-bcf2942445ef None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.122235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 440/905] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:41.125670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb256f-b922-444d-bd3b-bcf2942445ef None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.145926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.181071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d4d5a-f640-4f73-8af0-0acae6164923 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.193696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.220932 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278069-e3ec-47db-be7f-51330b7b7b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.221591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278069-e3ec-47db-be7f-51330b7b7b68 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.221897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278069-e3ec-47db-be7f-51330b7b7b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.222174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278069-e3ec-47db-be7f-51330b7b7b68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.222951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca278069-e3ec-47db-be7f-51330b7b7b68 None admin] RBAC: Adding query filter params (interface=public, service_id=471938a233fb46009d58e0e652db91c4, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:41.223273 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca278069-e3ec-47db-be7f-51330b7b7b68 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.224716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca278069-e3ec-47db-be7f-51330b7b7b68 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.230467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 466/906] 10.222.0.89 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/endpoints?service_id=471938a233fb46009d58e0e652db91c4&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:41.232004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8856dc2-3f0e-4f44-829f-48fa3313868a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.232317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8856dc2-3f0e-4f44-829f-48fa3313868a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.232742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8856dc2-3f0e-4f44-829f-48fa3313868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.237916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb256f-b922-444d-bd3b-bcf2942445ef None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.254284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e8856dc2-3f0e-4f44-829f-48fa3313868a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:41.255500 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e8856dc2-3f0e-4f44-829f-48fa3313868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:41.280018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317128a-cc0e-49fb-8c4f-251cadf8be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.280955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317128a-cc0e-49fb-8c4f-251cadf8be5c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.281404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317128a-cc0e-49fb-8c4f-251cadf8be5c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.281694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317128a-cc0e-49fb-8c4f-251cadf8be5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.331589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 467/907] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:41.332799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8856dc2-3f0e-4f44-829f-48fa3313868a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.380510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317128a-cc0e-49fb-8c4f-251cadf8be5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.383455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317128a-cc0e-49fb-8c4f-251cadf8be5c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.413990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.474362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.478614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8856dc2-3f0e-4f44-829f-48fa3313868a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.518998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 441/908] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:41.522259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de934fd-f032-460a-9c64-bf68fc9480b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.522878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de934fd-f032-460a-9c64-bf68fc9480b7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.523448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de934fd-f032-460a-9c64-bf68fc9480b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.523718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de934fd-f032-460a-9c64-bf68fc9480b7 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.524158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317128a-cc0e-49fb-8c4f-251cadf8be5c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.524407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de934fd-f032-460a-9c64-bf68fc9480b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.525699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de934fd-f032-460a-9c64-bf68fc9480b7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.532101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 468/909] 10.222.0.89 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:27:41.631055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de934fd-f032-460a-9c64-bf68fc9480b7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.639740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317128a-cc0e-49fb-8c4f-251cadf8be5c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.682882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffd10c-8d75-4adb-b4db-2517b79ab27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.683563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffd10c-8d75-4adb-b4db-2517b79ab27b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.683945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffd10c-8d75-4adb-b4db-2517b79ab27b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.684222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffd10c-8d75-4adb-b4db-2517b79ab27b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.696170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffd10c-8d75-4adb-b4db-2517b79ab27b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.698160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffd10c-8d75-4adb-b4db-2517b79ab27b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-47ffd10c-8d75-4adb-b4db-2517b79ab27b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:41.717403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:41.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:41.719774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:41.719774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:41.719774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:41.719774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 442/910] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:41.726682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffd10c-8d75-4adb-b4db-2517b79ab27b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.752517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.803537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de934fd-f032-460a-9c64-bf68fc9480b7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.844127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:41.856688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c6146-d3be-410b-8f0e-6ad41dc5112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.857325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c6146-d3be-410b-8f0e-6ad41dc5112c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.857589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c6146-d3be-410b-8f0e-6ad41dc5112c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.857865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c6146-d3be-410b-8f0e-6ad41dc5112c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.858463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c6146-d3be-410b-8f0e-6ad41dc5112c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.860496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c6146-d3be-410b-8f0e-6ad41dc5112c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1b7c6146-d3be-410b-8f0e-6ad41dc5112c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:41.873652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:41.875334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 15:27:41.876202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:41.879012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 469/911] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:41.883373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c6146-d3be-410b-8f0e-6ad41dc5112c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:41.888118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffd10c-8d75-4adb-b4db-2517b79ab27b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:41.927047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb8c8d-ce05-4965-9ab0-fe6b269715f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:41.928072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb8c8d-ce05-4965-9ab0-fe6b269715f8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:41.928727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb8c8d-ce05-4965-9ab0-fe6b269715f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:41.929212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb8c8d-ce05-4965-9ab0-fe6b269715f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:41.930976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb8c8d-ce05-4965-9ab0-fe6b269715f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:41.931591 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb8c8d-ce05-4965-9ab0-fe6b269715f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:41.933188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb8c8d-ce05-4965-9ab0-fe6b269715f8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:41.955603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 443/912] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:41.956077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb8c8d-ce05-4965-9ab0-fe6b269715f8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.020547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c6146-d3be-410b-8f0e-6ad41dc5112c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.055102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.073142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e932ea-13c5-44a6-942e-aa650c12be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.074185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e932ea-13c5-44a6-942e-aa650c12be57 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.074814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e932ea-13c5-44a6-942e-aa650c12be57 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.075461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e932ea-13c5-44a6-942e-aa650c12be57 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.076409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e932ea-13c5-44a6-942e-aa650c12be57 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:42.076917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e932ea-13c5-44a6-942e-aa650c12be57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.079928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e932ea-13c5-44a6-942e-aa650c12be57 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.085854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb8c8d-ce05-4965-9ab0-fe6b269715f8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.086738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 470/913] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:42.093116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e932ea-13c5-44a6-942e-aa650c12be57 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.128615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45f19-d9ee-41c7-83aa-273a4c58156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.129320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45f19-d9ee-41c7-83aa-273a4c58156b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.129629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45f19-d9ee-41c7-83aa-273a4c58156b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.129938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45f19-d9ee-41c7-83aa-273a4c58156b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.138114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e45f19-d9ee-41c7-83aa-273a4c58156b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.139526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e45f19-d9ee-41c7-83aa-273a4c58156b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-04e45f19-d9ee-41c7-83aa-273a4c58156b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:42.153649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:42.154696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:42.156012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:42.156012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:42.156012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:42.156012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:42.156012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:42.156012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:42.156012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:42.156012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:42.159060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 444/914] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:42.161654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45f19-d9ee-41c7-83aa-273a4c58156b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.175240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.228780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e932ea-13c5-44a6-942e-aa650c12be57 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.272963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1bd5-2baf-4b82-9a63-8c1009977fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.273687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1bd5-2baf-4b82-9a63-8c1009977fda None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.274109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1bd5-2baf-4b82-9a63-8c1009977fda None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.274490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be1bd5-2baf-4b82-9a63-8c1009977fda None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.275440 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1bd5-2baf-4b82-9a63-8c1009977fda None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:42.275876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1bd5-2baf-4b82-9a63-8c1009977fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.277736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be1bd5-2baf-4b82-9a63-8c1009977fda None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.280456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45f19-d9ee-41c7-83aa-273a4c58156b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.289361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 471/915] 10.222.0.89 () {56 vars in 1114 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:42.290838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1bd5-2baf-4b82-9a63-8c1009977fda None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.319329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4b55-834d-4abc-b67d-2b03ab764ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.320294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4b55-834d-4abc-b67d-2b03ab764ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.320749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4b55-834d-4abc-b67d-2b03ab764ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.321165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d4b55-834d-4abc-b67d-2b03ab764ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.322123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4b55-834d-4abc-b67d-2b03ab764ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:42.322581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4b55-834d-4abc-b67d-2b03ab764ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.324182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d4b55-834d-4abc-b67d-2b03ab764ce8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.326175 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.343083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 445/916] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:42.346503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4b55-834d-4abc-b67d-2b03ab764ce8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:42.449951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be1bd5-2baf-4b82-9a63-8c1009977fda None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.453542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d4b55-834d-4abc-b67d-2b03ab764ce8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:42.485528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.492817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf063b4-e544-4125-9d8b-84653a5dd272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.493704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf063b4-e544-4125-9d8b-84653a5dd272 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.494225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf063b4-e544-4125-9d8b-84653a5dd272 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.494697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf063b4-e544-4125-9d8b-84653a5dd272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.495724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf063b4-e544-4125-9d8b-84653a5dd272 None admin] RBAC: Adding query filter params (role.id=d054d237c41c4a96b795919b8532cda1, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=b91335b29d0b43d5993c44a3e40d4a5b) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:42.496329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf063b4-e544-4125-9d8b-84653a5dd272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.497947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf063b4-e544-4125-9d8b-84653a5dd272 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.510972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 446/917] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/role_assignments?user.id=b91335b29d0b43d5993c44a3e40d4a5b&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=d054d237c41c4a96b795919b8532cda1 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:42.510972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c589c2-e9ba-4e61-9a7f-638d1377570d None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.510972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c589c2-e9ba-4e61-9a7f-638d1377570d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.511315 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570d18e-3eb8-4449-90f6-dab480c89757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:42.511408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c589c2-e9ba-4e61-9a7f-638d1377570d None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.511487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570d18e-3eb8-4449-90f6-dab480c89757 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.511487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570d18e-3eb8-4449-90f6-dab480c89757 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.511487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570d18e-3eb8-4449-90f6-dab480c89757 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.511672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 447/918] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:42.512126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570d18e-3eb8-4449-90f6-dab480c89757 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:42.514229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570d18e-3eb8-4449-90f6-dab480c89757 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:42.517413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cad89-3ed4-4615-8be7-0a4e52697037 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:42.517699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cad89-3ed4-4615-8be7-0a4e52697037 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:42.517979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cad89-3ed4-4615-8be7-0a4e52697037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:42.538646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-840cad89-3ed4-4615-8be7-0a4e52697037 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:42.540216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-840cad89-3ed4-4615-8be7-0a4e52697037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:42.551453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 472/919] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:42.605409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:42.629778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 448/920] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:42.916022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570d18e-3eb8-4449-90f6-dab480c89757 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.022316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570d18e-3eb8-4449-90f6-dab480c89757 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.058828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e611be-75ce-47a8-9843-69a018a44668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.059436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e611be-75ce-47a8-9843-69a018a44668 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.060031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e611be-75ce-47a8-9843-69a018a44668 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.060311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e611be-75ce-47a8-9843-69a018a44668 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.060940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e611be-75ce-47a8-9843-69a018a44668 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.062908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e611be-75ce-47a8-9843-69a018a44668 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d3e611be-75ce-47a8-9843-69a018a44668 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:43.072344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:43.073380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:43.074385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 473/921] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:43.079937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cad89-3ed4-4615-8be7-0a4e52697037 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.190988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cad89-3ed4-4615-8be7-0a4e52697037 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.234697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f7772-e9b0-4d2e-b3f9-a4ee0d8adb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.235492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f7772-e9b0-4d2e-b3f9-a4ee0d8adb4f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.235816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f7772-e9b0-4d2e-b3f9-a4ee0d8adb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.236219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f7772-e9b0-4d2e-b3f9-a4ee0d8adb4f None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.237028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f7772-e9b0-4d2e-b3f9-a4ee0d8adb4f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:43.237369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f7772-e9b0-4d2e-b3f9-a4ee0d8adb4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.239317 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f7772-e9b0-4d2e-b3f9-a4ee0d8adb4f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.246203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 449/922] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:43.254104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e611be-75ce-47a8-9843-69a018a44668 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.302370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:43.373578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e611be-75ce-47a8-9843-69a018a44668 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.415970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8beb40-0da0-4420-aac8-b0fe56dc1fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.416576 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8beb40-0da0-4420-aac8-b0fe56dc1fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.416852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8beb40-0da0-4420-aac8-b0fe56dc1fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.417122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8beb40-0da0-4420-aac8-b0fe56dc1fc8 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.417757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8beb40-0da0-4420-aac8-b0fe56dc1fc8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:43.418055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8beb40-0da0-4420-aac8-b0fe56dc1fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.419699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8beb40-0da0-4420-aac8-b0fe56dc1fc8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.426925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 474/923] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:43.432662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f7772-e9b0-4d2e-b3f9-a4ee0d8adb4f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.489217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:43.545160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f7772-e9b0-4d2e-b3f9-a4ee0d8adb4f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.581078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357756f-4423-4698-acbb-66b35e28e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.581739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357756f-4423-4698-acbb-66b35e28e293 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.582024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357756f-4423-4698-acbb-66b35e28e293 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.582295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357756f-4423-4698-acbb-66b35e28e293 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.583038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357756f-4423-4698-acbb-66b35e28e293 None admin] RBAC: Adding query filter params (interface=public, service_id=b958cfe768624ac4bc42c04df1956d98, region_id=RegionOne) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:43.583350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357756f-4423-4698-acbb-66b35e28e293 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.584737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357756f-4423-4698-acbb-66b35e28e293 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.590759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 450/924] 10.222.0.89 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/endpoints?service_id=b958cfe768624ac4bc42c04df1956d98&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:43.596283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8beb40-0da0-4420-aac8-b0fe56dc1fc8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:43.626128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c3e18-d02f-458b-8afa-274bfa4d90a6 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.626424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c3e18-d02f-458b-8afa-274bfa4d90a6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.626609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c3e18-d02f-458b-8afa-274bfa4d90a6 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.632247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 451/925] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:43.634013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c666c-6bef-4f1c-a200-de3c52655c9a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.634301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c666c-6bef-4f1c-a200-de3c52655c9a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.634583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c666c-6bef-4f1c-a200-de3c52655c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.657874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-2a5c666c-6bef-4f1c-a200-de3c52655c9a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:43.659477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2a5c666c-6bef-4f1c-a200-de3c52655c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:43.710367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8beb40-0da0-4420-aac8-b0fe56dc1fc8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:43.713527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:43.746211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 452/926] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:43.751329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5a6de-17f9-474b-9797-6dd73aa8783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:43.751972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5a6de-17f9-474b-9797-6dd73aa8783b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:43.752247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5a6de-17f9-474b-9797-6dd73aa8783b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:43.752517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5a6de-17f9-474b-9797-6dd73aa8783b None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:43.753201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5a6de-17f9-474b-9797-6dd73aa8783b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:43.754618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5a6de-17f9-474b-9797-6dd73aa8783b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:43.761740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 475/927] 10.222.0.89 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:43 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:27:44.044962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c666c-6bef-4f1c-a200-de3c52655c9a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.099011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:44.170615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c666c-6bef-4f1c-a200-de3c52655c9a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.214765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37279c5e-3f74-4b3c-86b7-82e7d2bf0632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.215444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37279c5e-3f74-4b3c-86b7-82e7d2bf0632 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.215721 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37279c5e-3f74-4b3c-86b7-82e7d2bf0632 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.215995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37279c5e-3f74-4b3c-86b7-82e7d2bf0632 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.216595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37279c5e-3f74-4b3c-86b7-82e7d2bf0632 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.217962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37279c5e-3f74-4b3c-86b7-82e7d2bf0632 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-37279c5e-3f74-4b3c-86b7-82e7d2bf0632 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:44.227713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:44.228665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:44.229536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 453/928] 10.222.0.89 () {56 vars in 1132 bytes} [Fri Aug 26 15:27:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:44.235585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5a6de-17f9-474b-9797-6dd73aa8783b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.344542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5a6de-17f9-474b-9797-6dd73aa8783b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.379897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff65e-b970-4a77-a436-f592033c7987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.380514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff65e-b970-4a77-a436-f592033c7987 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.380798 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff65e-b970-4a77-a436-f592033c7987 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.381081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff65e-b970-4a77-a436-f592033c7987 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.381720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff65e-b970-4a77-a436-f592033c7987 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:44.382025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff65e-b970-4a77-a436-f592033c7987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.383435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff65e-b970-4a77-a436-f592033c7987 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.393055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 476/929] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:44.395481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37279c5e-3f74-4b3c-86b7-82e7d2bf0632 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.501305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37279c5e-3f74-4b3c-86b7-82e7d2bf0632 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.508819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:44.537669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b8158-30a2-49a8-a178-cdc37cac5dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.538295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b8158-30a2-49a8-a178-cdc37cac5dfc None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.538576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b8158-30a2-49a8-a178-cdc37cac5dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.538846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b8158-30a2-49a8-a178-cdc37cac5dfc None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.539517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b8158-30a2-49a8-a178-cdc37cac5dfc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:44.539820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b8158-30a2-49a8-a178-cdc37cac5dfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.541206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b8158-30a2-49a8-a178-cdc37cac5dfc None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.547732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 454/930] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:44.553323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff65e-b970-4a77-a436-f592033c7987 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:44.591983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:44.667497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d3ba3-bd40-4773-8248-e5672e4201dc None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.667688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff65e-b970-4a77-a436-f592033c7987 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:44.667771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d3ba3-bd40-4773-8248-e5672e4201dc None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.667993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d3ba3-bd40-4773-8248-e5672e4201dc None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.669314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 455/931] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:44.678070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68c6d-3c05-4d89-b521-c3d3ff315ebc None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.678339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68c6d-3c05-4d89-b521-c3d3ff315ebc None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.678629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68c6d-3c05-4d89-b521-c3d3ff315ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.699785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-67e68c6d-3c05-4d89-b521-c3d3ff315ebc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:44.701161 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-67e68c6d-3c05-4d89-b521-c3d3ff315ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:44.715238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5be24f-0af8-4b67-b7fb-9a9dac4245ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:44.715973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5be24f-0af8-4b67-b7fb-9a9dac4245ab None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.716373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5be24f-0af8-4b67-b7fb-9a9dac4245ab None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.716707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5be24f-0af8-4b67-b7fb-9a9dac4245ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.717542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5be24f-0af8-4b67-b7fb-9a9dac4245ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:44.719787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5be24f-0af8-4b67-b7fb-9a9dac4245ab None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:44.755800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 477/932] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:44.758099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf1b7b-ee44-466c-a032-f685bf26db45 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.758555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf1b7b-ee44-466c-a032-f685bf26db45 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.759238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf1b7b-ee44-466c-a032-f685bf26db45 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.763497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 478/933] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:44.767537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd6e4d-e95c-47ca-bfdb-88cbf9e3e13a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:44.768231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd6e4d-e95c-47ca-bfdb-88cbf9e3e13a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:44.768231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd6e4d-e95c-47ca-bfdb-88cbf9e3e13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:44.788931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7dfd6e4d-e95c-47ca-bfdb-88cbf9e3e13a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:44.790443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7dfd6e4d-e95c-47ca-bfdb-88cbf9e3e13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:44.799370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 456/934] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:44.879987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 479/935] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:45.074336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e68c6d-3c05-4d89-b521-c3d3ff315ebc None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.175636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:45.178255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd6e4d-e95c-47ca-bfdb-88cbf9e3e13a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.181383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e68c6d-3c05-4d89-b521-c3d3ff315ebc None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.200591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:45.218895 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd1d52-60a7-4b78-b690-4ae2eac10658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.219570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd1d52-60a7-4b78-b690-4ae2eac10658 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.219859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd1d52-60a7-4b78-b690-4ae2eac10658 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.220137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd1d52-60a7-4b78-b690-4ae2eac10658 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.238237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd1d52-60a7-4b78-b690-4ae2eac10658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-52cd1d52-60a7-4b78-b690-4ae2eac10658 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:45.244159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:45.245224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:45.246211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 457/936] 10.222.0.89 () {56 vars in 1120 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:45.253156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd1d52-60a7-4b78-b690-4ae2eac10658 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.314035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd6e4d-e95c-47ca-bfdb-88cbf9e3e13a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.358623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.359232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.359511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.359782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.360431 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.362355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.366166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING keystone.server.flask.common [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 15:27:45.374124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd1d52-60a7-4b78-b690-4ae2eac10658 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.387246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.sql.core [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 15:27:45.387246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 15:27:45.387246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [parameters: {'id': 'ef33298e6b4340c0a1b7d653a67a11ef', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 15:27:45.387246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81766) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef33298e6b4340c0a1b7d653a67a11ef.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef33298e6b4340c0a1b7d653a67a11ef. Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:27:45.397683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 26 15:27:45.398542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application yield resource Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise self.value Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application session.commit() Aug 26 15:27:45.399904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.flush() Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application compat.raise_( Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 15:27:45.400789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 15:27:45.401718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:27:45.402511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [parameters: {'id': 'ef33298e6b4340c0a1b7d653a67a11ef', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:45.403433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:45.404258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef33298e6b4340c0a1b7d653a67a11ef. Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:45.405184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 480/937] 10.222.0.89 () {60 vars in 1140 bytes} [Fri Aug 26 15:27:45 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:45.407552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.427614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4511dd2-10d9-442f-9498-3f0cae1beec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.428612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4511dd2-10d9-442f-9498-3f0cae1beec4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.429116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4511dd2-10d9-442f-9498-3f0cae1beec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.429673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4511dd2-10d9-442f-9498-3f0cae1beec4 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.430582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4511dd2-10d9-442f-9498-3f0cae1beec4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:45.431187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4511dd2-10d9-442f-9498-3f0cae1beec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.432875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4511dd2-10d9-442f-9498-3f0cae1beec4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.442492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 458/938] 10.222.0.89 () {56 vars in 1115 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:45.449705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4511dd2-10d9-442f-9498-3f0cae1beec4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.476336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:45.501557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:45.539569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a947a-b3a4-4094-a466-515eb30c5014 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.581016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb1b3c-480b-4779-a541-6681825cf859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.581887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1b3c-480b-4779-a541-6681825cf859 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.582298 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1b3c-480b-4779-a541-6681825cf859 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.583166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb1b3c-480b-4779-a541-6681825cf859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.594364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb1b3c-480b-4779-a541-6681825cf859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.596151 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb1b3c-480b-4779-a541-6681825cf859 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.606704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4511dd2-10d9-442f-9498-3f0cae1beec4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-19bb1b3c-480b-4779-a541-6681825cf859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:45.612223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:45.613544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:45.615230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:45.615230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:45.615230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:45.615230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:45.615230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:45.615230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:45.615230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:45.615230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:45.618875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 481/939] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:45.619855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb1b3c-480b-4779-a541-6681825cf859 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.652137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36c38-40c0-4b3e-8828-e65f7bfac0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.653100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36c38-40c0-4b3e-8828-e65f7bfac0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.653542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36c38-40c0-4b3e-8828-e65f7bfac0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.653966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c36c38-40c0-4b3e-8828-e65f7bfac0b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.666236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c36c38-40c0-4b3e-8828-e65f7bfac0b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.668000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c36c38-40c0-4b3e-8828-e65f7bfac0b5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-31c36c38-40c0-4b3e-8828-e65f7bfac0b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:45.683923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:45.685115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:45.686154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:45.686154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:45.686154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:45.692431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 459/940] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:45.693934 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36c38-40c0-4b3e-8828-e65f7bfac0b5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.738706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb1b3c-480b-4779-a541-6681825cf859 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.770374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:45.774605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc1bb4-cabb-409b-8f2e-f2fd441c8368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.775264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc1bb4-cabb-409b-8f2e-f2fd441c8368 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.775548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc1bb4-cabb-409b-8f2e-f2fd441c8368 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.775821 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc1bb4-cabb-409b-8f2e-f2fd441c8368 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.779503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc1bb4-cabb-409b-8f2e-f2fd441c8368 None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:45.779847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc1bb4-cabb-409b-8f2e-f2fd441c8368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.781842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc1bb4-cabb-409b-8f2e-f2fd441c8368 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.783683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:45.810597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c36c38-40c0-4b3e-8828-e65f7bfac0b5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:45.819076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 482/941] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:45.834394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22f636-b42f-4957-bad5-a0ad0b9ecae2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.834678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22f636-b42f-4957-bad5-a0ad0b9ecae2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.834977 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22f636-b42f-4957-bad5-a0ad0b9ecae2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.840878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 483/942] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:45.842312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d42b23-e54a-42b9-876f-6a6f002dabc6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.842598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d42b23-e54a-42b9-876f-6a6f002dabc6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.842875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d42b23-e54a-42b9-876f-6a6f002dabc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.867644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-77d42b23-e54a-42b9-876f-6a6f002dabc6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:45.869821 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-77d42b23-e54a-42b9-876f-6a6f002dabc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:45.870778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf7355-72ab-4326-b290-8ecec3d2fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:45.871455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf7355-72ab-4326-b290-8ecec3d2fea4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:45.871734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf7355-72ab-4326-b290-8ecec3d2fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:45.872010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf7355-72ab-4326-b290-8ecec3d2fea4 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:45.872686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf7355-72ab-4326-b290-8ecec3d2fea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:45.872993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf7355-72ab-4326-b290-8ecec3d2fea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:45.874492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf7355-72ab-4326-b290-8ecec3d2fea4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:45.888534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 460/943] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:45.894971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf7355-72ab-4326-b290-8ecec3d2fea4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:45.978990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 484/944] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:46.032296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf7355-72ab-4326-b290-8ecec3d2fea4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.062728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.067929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50016-3924-4ec6-86f5-bc4023c2e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.068862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50016-3924-4ec6-86f5-bc4023c2e433 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.069390 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50016-3924-4ec6-86f5-bc4023c2e433 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.069771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd50016-3924-4ec6-86f5-bc4023c2e433 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.077327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd50016-3924-4ec6-86f5-bc4023c2e433 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.079526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd50016-3924-4ec6-86f5-bc4023c2e433 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-edd50016-3924-4ec6-86f5-bc4023c2e433 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:46.091307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:46.092253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:46.093944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 461/945] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:46.101027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d42b23-e54a-42b9-876f-6a6f002dabc6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.213862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d42b23-e54a-42b9-876f-6a6f002dabc6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.238739 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.251587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17146b31-e340-46a7-b008-46f22c422d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.252459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17146b31-e340-46a7-b008-46f22c422d47 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.252890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17146b31-e340-46a7-b008-46f22c422d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.253309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17146b31-e340-46a7-b008-46f22c422d47 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.254375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17146b31-e340-46a7-b008-46f22c422d47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:46.254678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17146b31-e340-46a7-b008-46f22c422d47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.255132 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50016-3924-4ec6-86f5-bc4023c2e433 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.256270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17146b31-e340-46a7-b008-46f22c422d47 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.287087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 485/946] 10.222.0.89 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:46.289048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17146b31-e340-46a7-b008-46f22c422d47 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.370071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd50016-3924-4ec6-86f5-bc4023c2e433 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.407201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77402a-7cd3-4075-aba3-1f07c40737cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.407841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77402a-7cd3-4075-aba3-1f07c40737cb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.408127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77402a-7cd3-4075-aba3-1f07c40737cb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.408406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77402a-7cd3-4075-aba3-1f07c40737cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.409001 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77402a-7cd3-4075-aba3-1f07c40737cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.410386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77402a-7cd3-4075-aba3-1f07c40737cb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.413929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17146b31-e340-46a7-b008-46f22c422d47 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-7c77402a-7cd3-4075-aba3-1f07c40737cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:46.421152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:46.422224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:46.423125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 462/947] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:46.428796 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77402a-7cd3-4075-aba3-1f07c40737cb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.455400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8029005-db45-43ad-8719-f049f8bb7ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.456442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8029005-db45-43ad-8719-f049f8bb7ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.456835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8029005-db45-43ad-8719-f049f8bb7ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.457220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8029005-db45-43ad-8719-f049f8bb7ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.468358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8029005-db45-43ad-8719-f049f8bb7ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.469886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8029005-db45-43ad-8719-f049f8bb7ed7 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d8029005-db45-43ad-8719-f049f8bb7ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:46.485223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:46.486208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:46.487106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:46.487106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:46.487106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:46.491419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 486/948] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:46.492735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8029005-db45-43ad-8719-f049f8bb7ed7 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.505831 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.534349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.568897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77402a-7cd3-4075-aba3-1f07c40737cb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.614956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3489-7718-4897-af20-bba66fa02436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.615672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3489-7718-4897-af20-bba66fa02436 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.616059 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3489-7718-4897-af20-bba66fa02436 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.616338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3489-7718-4897-af20-bba66fa02436 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.616981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3489-7718-4897-af20-bba66fa02436 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:46.617289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3489-7718-4897-af20-bba66fa02436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.618664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3489-7718-4897-af20-bba66fa02436 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.618861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8029005-db45-43ad-8719-f049f8bb7ed7 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.624415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 463/949] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:46.630305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3489-7718-4897-af20-bba66fa02436 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.657018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280eaea6-21e3-4ede-8070-7d15401ab7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.657635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280eaea6-21e3-4ede-8070-7d15401ab7df None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.657926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280eaea6-21e3-4ede-8070-7d15401ab7df None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.658195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280eaea6-21e3-4ede-8070-7d15401ab7df None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.658849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280eaea6-21e3-4ede-8070-7d15401ab7df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:46.659209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280eaea6-21e3-4ede-8070-7d15401ab7df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.660840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280eaea6-21e3-4ede-8070-7d15401ab7df None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.678403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 487/950] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:46.679863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280eaea6-21e3-4ede-8070-7d15401ab7df None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.744255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3489-7718-4897-af20-bba66fa02436 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.763449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.781572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:46.786219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424b298-5a04-4acb-bfd6-9e9e5140ce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.787128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424b298-5a04-4acb-bfd6-9e9e5140ce62 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.787540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424b298-5a04-4acb-bfd6-9e9e5140ce62 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.787932 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424b298-5a04-4acb-bfd6-9e9e5140ce62 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.788713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424b298-5a04-4acb-bfd6-9e9e5140ce62 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:46.789154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424b298-5a04-4acb-bfd6-9e9e5140ce62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.789291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280eaea6-21e3-4ede-8070-7d15401ab7df None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.790881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424b298-5a04-4acb-bfd6-9e9e5140ce62 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.801598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 464/951] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:46.802763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424b298-5a04-4acb-bfd6-9e9e5140ce62 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.826103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bd077-a97a-43e6-880a-a1b971c55ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.826782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bd077-a97a-43e6-880a-a1b971c55ffd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.827118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bd077-a97a-43e6-880a-a1b971c55ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.827916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bd077-a97a-43e6-880a-a1b971c55ffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.835427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bd077-a97a-43e6-880a-a1b971c55ffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.836934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bd077-a97a-43e6-880a-a1b971c55ffd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a77bd077-a97a-43e6-880a-a1b971c55ffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:46.849602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:46.850601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:46.851789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:46.851789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:46.851789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:46.851789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:46.851789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:46.851789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:46.851789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:46.851789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:46.856134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 488/952] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:46.857086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bd077-a97a-43e6-880a-a1b971c55ffd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:46.919988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424b298-5a04-4acb-bfd6-9e9e5140ce62 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.957436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1a5f5-9484-4ccd-a0a5-f18485818be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:46.958045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1a5f5-9484-4ccd-a0a5-f18485818be0 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.958322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1a5f5-9484-4ccd-a0a5-f18485818be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.958598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1a5f5-9484-4ccd-a0a5-f18485818be0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:46.959293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1a5f5-9484-4ccd-a0a5-f18485818be0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:46.960647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1a5f5-9484-4ccd-a0a5-f18485818be0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:46.967730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bd077-a97a-43e6-880a-a1b971c55ffd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:46.995224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 465/953] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:46.996634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450c965-87da-4c75-b209-fa2c20fe3ad0 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:46.996922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450c965-87da-4c75-b209-fa2c20fe3ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:46.997395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450c965-87da-4c75-b209-fa2c20fe3ad0 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.003311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 466/954] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:47.005800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616a6d5-406d-4e34-8d2a-7ba14c974ca5 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.006086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616a6d5-406d-4e34-8d2a-7ba14c974ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.006354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616a6d5-406d-4e34-8d2a-7ba14c974ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.023772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd50bdd-f0df-4cc3-973b-bfbd3d606903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.024544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd50bdd-f0df-4cc3-973b-bfbd3d606903 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.024896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd50bdd-f0df-4cc3-973b-bfbd3d606903 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.025242 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd50bdd-f0df-4cc3-973b-bfbd3d606903 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.026390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd50bdd-f0df-4cc3-973b-bfbd3d606903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:47.026566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd50bdd-f0df-4cc3-973b-bfbd3d606903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.028257 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd50bdd-f0df-4cc3-973b-bfbd3d606903 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.032149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-3616a6d5-406d-4e34-8d2a-7ba14c974ca5 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:47.033435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3616a6d5-406d-4e34-8d2a-7ba14c974ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:47.043225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 489/955] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:47.052336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd50bdd-f0df-4cc3-973b-bfbd3d606903 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.069517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.074546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.130970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 467/956] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:47.202226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd50bdd-f0df-4cc3-973b-bfbd3d606903 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.238228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5d06d-0bda-4639-97eb-f2e5b42775ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.238894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5d06d-0bda-4639-97eb-f2e5b42775ac None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.239187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5d06d-0bda-4639-97eb-f2e5b42775ac None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.239463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5d06d-0bda-4639-97eb-f2e5b42775ac None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/b91335b29d0b43d5993c44a3e40d4a5b/roles/d054d237c41c4a96b795919b8532cda1` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.241624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5d06d-0bda-4639-97eb-f2e5b42775ac None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=b91335b29d0b43d5993c44a3e40d4a5b, role_id=d054d237c41c4a96b795919b8532cda1)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.243064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5d06d-0bda-4639-97eb-f2e5b42775ac None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.257592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 490/957] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:27:47 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/b91335b29d0b43d5993c44a3e40d4a5b/roles/d054d237c41c4a96b795919b8532cda1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:27:47.410044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616a6d5-406d-4e34-8d2a-7ba14c974ca5 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.514820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616a6d5-406d-4e34-8d2a-7ba14c974ca5 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.553474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deadcc7-d7a5-44f7-a96a-546bc1e321f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.554112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deadcc7-d7a5-44f7-a96a-546bc1e321f4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.554391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deadcc7-d7a5-44f7-a96a-546bc1e321f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.554662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deadcc7-d7a5-44f7-a96a-546bc1e321f4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.555297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deadcc7-d7a5-44f7-a96a-546bc1e321f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.556727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deadcc7-d7a5-44f7-a96a-546bc1e321f4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-0deadcc7-d7a5-44f7-a96a-546bc1e321f4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:47.566035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:47.567219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:47.568110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 468/958] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:47.573320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5d06d-0bda-4639-97eb-f2e5b42775ac None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.654056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.680516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5d06d-0bda-4639-97eb-f2e5b42775ac None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.715889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dcb77-0c10-4e98-9478-d01aa7db7e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.716505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dcb77-0c10-4e98-9478-d01aa7db7e84 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.716781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dcb77-0c10-4e98-9478-d01aa7db7e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.717053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dcb77-0c10-4e98-9478-d01aa7db7e84 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.717743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dcb77-0c10-4e98-9478-d01aa7db7e84 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:47.718083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dcb77-0c10-4e98-9478-d01aa7db7e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.719535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dcb77-0c10-4e98-9478-d01aa7db7e84 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.725121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 491/959] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:47.730826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deadcc7-d7a5-44f7-a96a-546bc1e321f4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:47.767499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:47.841117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deadcc7-d7a5-44f7-a96a-546bc1e321f4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:47.876381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32b4ae-3458-4fe6-9641-aad68060271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:47.876990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32b4ae-3458-4fe6-9641-aad68060271f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.877271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32b4ae-3458-4fe6-9641-aad68060271f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.877540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32b4ae-3458-4fe6-9641-aad68060271f None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.878173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32b4ae-3458-4fe6-9641-aad68060271f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:47.878477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32b4ae-3458-4fe6-9641-aad68060271f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:47.879872 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32b4ae-3458-4fe6-9641-aad68060271f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:47.884888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 469/960] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:47.991513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1c731-2b1e-41aa-81bf-4bf48a47570c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:47.992193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1c731-2b1e-41aa-81bf-4bf48a47570c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:47.992683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1c731-2b1e-41aa-81bf-4bf48a47570c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:47.994651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 492/961] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:48.000739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55b664-cd88-4486-8116-569aa1aee133 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.001045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55b664-cd88-4486-8116-569aa1aee133 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.001293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55b664-cd88-4486-8116-569aa1aee133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.021406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-dc55b664-cd88-4486-8116-569aa1aee133 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:48.022650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-dc55b664-cd88-4486-8116-569aa1aee133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:48.102144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 470/962] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:48.373852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1c731-2b1e-41aa-81bf-4bf48a47570c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.482650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1c731-2b1e-41aa-81bf-4bf48a47570c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.519497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.520165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.520443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.520713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.521361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.522787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.535510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:48.539099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.sql.core [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 15:27:48.539099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 15:27:48.539099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [parameters: {'user_id': '6d4ec9bba2a04a2abe41454d0792a6dc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 15:27:48.539099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81766) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Aug 26 15:27:48.547991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:27:48.548965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application yield resource Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application next(self.gen) Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise self.value Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application session.commit() Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 15:27:48.549926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.session.flush() Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application compat.raise_( Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 15:27:48.550825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 15:27:48.552022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application conn.query(q) Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application result.read() Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 15:27:48.552915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [parameters: {'user_id': '6d4ec9bba2a04a2abe41454d0792a6dc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:48.553805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 26 15:27:48.554604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 26 15:27:48.555621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 26 15:27:48.555621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 26 15:27:48.555621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 15:27:48.555621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 15:27:48.555621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 15:27:48.555621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:48.557713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 493/963] 10.222.0.89 () {60 vars in 1131 bytes} [Fri Aug 26 15:27:48 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:48.564143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55b664-cd88-4486-8116-569aa1aee133 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.599480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:48.680629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55b664-cd88-4486-8116-569aa1aee133 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.716727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a9ae-d6aa-4ef1-ba9c-d5f4e50dc4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.717370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a9ae-d6aa-4ef1-ba9c-d5f4e50dc4be None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.717646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a9ae-d6aa-4ef1-ba9c-d5f4e50dc4be None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.718606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a9ae-d6aa-4ef1-ba9c-d5f4e50dc4be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.726180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873a9ae-d6aa-4ef1-ba9c-d5f4e50dc4be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.727664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873a9ae-d6aa-4ef1-ba9c-d5f4e50dc4be None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-f873a9ae-d6aa-4ef1-ba9c-d5f4e50dc4be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:48.739819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:48.740956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:48.742118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 471/964] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:27:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:48.747040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:48.852957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e7686-6575-45cf-be8e-b3131f914892 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:48.888342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba561f52-6135-45c2-9cb5-6b92c2a88da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:48.889064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba561f52-6135-45c2-9cb5-6b92c2a88da4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:48.889420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba561f52-6135-45c2-9cb5-6b92c2a88da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:48.889765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba561f52-6135-45c2-9cb5-6b92c2a88da4 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:48.891456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba561f52-6135-45c2-9cb5-6b92c2a88da4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:48.891879 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba561f52-6135-45c2-9cb5-6b92c2a88da4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:48.893568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba561f52-6135-45c2-9cb5-6b92c2a88da4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:48.934887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 494/965] 10.222.0.89 () {56 vars in 1101 bytes} [Fri Aug 26 15:27:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:49.060256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a253a-9678-4fe8-8087-9d896e60d81c None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.060720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a253a-9678-4fe8-8087-9d896e60d81c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.061098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a253a-9678-4fe8-8087-9d896e60d81c None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.062989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 472/966] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:49.069141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0332-4fad-44be-8bcf-d8572217eb83 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.069587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0332-4fad-44be-8bcf-d8572217eb83 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.069965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0332-4fad-44be-8bcf-d8572217eb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.090330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-254a0332-4fad-44be-8bcf-d8572217eb83 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:49.092213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-254a0332-4fad-44be-8bcf-d8572217eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:49.145329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:49.165530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 495/967] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:49.344895 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855ffb4-5067-4f8b-9ff0-02adae7cb751 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.345218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855ffb4-5067-4f8b-9ff0-02adae7cb751 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.345492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855ffb4-5067-4f8b-9ff0-02adae7cb751 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.346993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 473/968] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:49.352144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96603-ff81-4463-8f40-d7180d8832b1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.352437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96603-ff81-4463-8f40-d7180d8832b1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.352718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96603-ff81-4463-8f40-d7180d8832b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.372094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-91c96603-ff81-4463-8f40-d7180d8832b1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:49.373147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-91c96603-ff81-4463-8f40-d7180d8832b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:49.440537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855ffb4-5067-4f8b-9ff0-02adae7cb751 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:49.445646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 496/969] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:49.532319 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:49.550833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855ffb4-5067-4f8b-9ff0-02adae7cb751 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:49.586377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c24516-409c-4ed6-bf5c-0d01d8e5ffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:49.587124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c24516-409c-4ed6-bf5c-0d01d8e5ffc5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.587484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c24516-409c-4ed6-bf5c-0d01d8e5ffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.587816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c24516-409c-4ed6-bf5c-0d01d8e5ffc5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.588473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c24516-409c-4ed6-bf5c-0d01d8e5ffc5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:49.589953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c24516-409c-4ed6-bf5c-0d01d8e5ffc5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-57c24516-409c-4ed6-bf5c-0d01d8e5ffc5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:49.599839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:49.601054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:49.602079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:49.607386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 474/970] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:49.608226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c96603-ff81-4463-8f40-d7180d8832b1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:49.712521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c96603-ff81-4463-8f40-d7180d8832b1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:49.724661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c24516-409c-4ed6-bf5c-0d01d8e5ffc5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:49.729345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:49.752764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799ca6d-aeb8-4d9b-9410-6206b4ebe83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:49.753405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799ca6d-aeb8-4d9b-9410-6206b4ebe83d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.753643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799ca6d-aeb8-4d9b-9410-6206b4ebe83d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.753915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799ca6d-aeb8-4d9b-9410-6206b4ebe83d None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.754551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799ca6d-aeb8-4d9b-9410-6206b4ebe83d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:49.754855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799ca6d-aeb8-4d9b-9410-6206b4ebe83d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:49.756251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799ca6d-aeb8-4d9b-9410-6206b4ebe83d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:49.761660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 497/971] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:49.768852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799ca6d-aeb8-4d9b-9410-6206b4ebe83d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:49.841760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c24516-409c-4ed6-bf5c-0d01d8e5ffc5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:49.878746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df254c6e-6ff0-4d8c-9fcb-bf56fe82647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:49.879372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254c6e-6ff0-4d8c-9fcb-bf56fe82647c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.879646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254c6e-6ff0-4d8c-9fcb-bf56fe82647c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.879879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254c6e-6ff0-4d8c-9fcb-bf56fe82647c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.887229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799ca6d-aeb8-4d9b-9410-6206b4ebe83d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:49.891934 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df254c6e-6ff0-4d8c-9fcb-bf56fe82647c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-df254c6e-6ff0-4d8c-9fcb-bf56fe82647c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:49.897169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:49.899448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 475/972] 10.222.0.89 () {56 vars in 1120 bytes} [Fri Aug 26 15:27:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:49.900393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46295d2a-f946-4112-9ce0-4aaaff6392d6 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.901161 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46295d2a-f946-4112-9ce0-4aaaff6392d6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.901161 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46295d2a-f946-4112-9ce0-4aaaff6392d6 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.901282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 476/973] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:49.904266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46295d2a-f946-4112-9ce0-4aaaff6392d6 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:49.917570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:49.927542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7385d-e5ae-4854-94b1-8b5c7689336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:49.928157 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7385d-e5ae-4854-94b1-8b5c7689336f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.928436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7385d-e5ae-4854-94b1-8b5c7689336f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.928710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7385d-e5ae-4854-94b1-8b5c7689336f None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.929348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7385d-e5ae-4854-94b1-8b5c7689336f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:49.929652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7385d-e5ae-4854-94b1-8b5c7689336f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:49.931062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7385d-e5ae-4854-94b1-8b5c7689336f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:49.936015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 498/974] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:49.937327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80cbb7-c3e4-4d46-8dc2-f9084f59246b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:49.937610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80cbb7-c3e4-4d46-8dc2-f9084f59246b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:49.937880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80cbb7-c3e4-4d46-8dc2-f9084f59246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:49.956563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ab80cbb7-c3e4-4d46-8dc2-f9084f59246b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:49.957756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ab80cbb7-c3e4-4d46-8dc2-f9084f59246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:49.993286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:50.014179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46295d2a-f946-4112-9ce0-4aaaff6392d6 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.025945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 499/975] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:50.026916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80cbb7-c3e4-4d46-8dc2-f9084f59246b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.051370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfaef0-28c4-4612-9d30-3ad31aa3e2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.051975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfaef0-28c4-4612-9d30-3ad31aa3e2da None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.052250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfaef0-28c4-4612-9d30-3ad31aa3e2da None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.052552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfaef0-28c4-4612-9d30-3ad31aa3e2da None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.053227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfaef0-28c4-4612-9d30-3ad31aa3e2da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:50.053525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfaef0-28c4-4612-9d30-3ad31aa3e2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.055177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfaef0-28c4-4612-9d30-3ad31aa3e2da None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.068677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 477/976] 10.222.0.89 () {56 vars in 1115 bytes} [Fri Aug 26 15:27:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:50.069759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfaef0-28c4-4612-9d30-3ad31aa3e2da None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.131545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80cbb7-c3e4-4d46-8dc2-f9084f59246b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.144644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:50.168112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398921-c38c-4a32-8305-36499d8cc7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.168733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398921-c38c-4a32-8305-36499d8cc7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.169014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398921-c38c-4a32-8305-36499d8cc7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.169291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398921-c38c-4a32-8305-36499d8cc7f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.170021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d398921-c38c-4a32-8305-36499d8cc7f8 None admin] RBAC: Adding query filter params (interface=admin, service_id=b958cfe768624ac4bc42c04df1956d98, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:50.170329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d398921-c38c-4a32-8305-36499d8cc7f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.171779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d398921-c38c-4a32-8305-36499d8cc7f8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.177555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 500/977] 10.222.0.89 () {56 vars in 1249 bytes} [Fri Aug 26 15:27:50 2022] GET /identity/v3/endpoints?service_id=b958cfe768624ac4bc42c04df1956d98&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:50.178104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfaef0-28c4-4612-9d30-3ad31aa3e2da None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.183350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398921-c38c-4a32-8305-36499d8cc7f8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.219900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:50.231840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226e96-32a7-4f74-8e37-113dada5036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.232541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226e96-32a7-4f74-8e37-113dada5036d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.232766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226e96-32a7-4f74-8e37-113dada5036d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.233035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226e96-32a7-4f74-8e37-113dada5036d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.244106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12226e96-32a7-4f74-8e37-113dada5036d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.245576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12226e96-32a7-4f74-8e37-113dada5036d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-12226e96-32a7-4f74-8e37-113dada5036d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:50.262263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:50.269410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:50.270570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:50.270570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:50.270570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:50.270570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 478/978] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:50.272451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226e96-32a7-4f74-8e37-113dada5036d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.296652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d398921-c38c-4a32-8305-36499d8cc7f8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.343843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c9a2-5e02-459d-9afc-fd2bd1995810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.344565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c9a2-5e02-459d-9afc-fd2bd1995810 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.344843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c9a2-5e02-459d-9afc-fd2bd1995810 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.345109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c9a2-5e02-459d-9afc-fd2bd1995810 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.345734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8c9a2-5e02-459d-9afc-fd2bd1995810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.347158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8c9a2-5e02-459d-9afc-fd2bd1995810 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.353796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 501/979] 10.222.0.89 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:50 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:27:50.354621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c9a2-5e02-459d-9afc-fd2bd1995810 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.396344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226e96-32a7-4f74-8e37-113dada5036d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.422550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:50.435506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9ab83-3efa-43e9-9c96-388dc11c30a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.436229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ab83-3efa-43e9-9c96-388dc11c30a5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.436584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ab83-3efa-43e9-9c96-388dc11c30a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.437468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ab83-3efa-43e9-9c96-388dc11c30a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.438152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9ab83-3efa-43e9-9c96-388dc11c30a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:50.438465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9ab83-3efa-43e9-9c96-388dc11c30a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.439898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9ab83-3efa-43e9-9c96-388dc11c30a5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.454004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 479/980] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:50.459661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9ab83-3efa-43e9-9c96-388dc11c30a5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.480172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:50.485362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c9a2-5e02-459d-9afc-fd2bd1995810 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.526618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724e232-592a-4ca0-9941-edd25175b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.527268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724e232-592a-4ca0-9941-edd25175b2b5 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.527552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724e232-592a-4ca0-9941-edd25175b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.527835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724e232-592a-4ca0-9941-edd25175b2b5 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.528490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724e232-592a-4ca0-9941-edd25175b2b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.529856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724e232-592a-4ca0-9941-edd25175b2b5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.545109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 502/981] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:50 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:50.578227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9ab83-3efa-43e9-9c96-388dc11c30a5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.628192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376de9c-7431-4b9e-8d8c-e6c1f80f3d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.628846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376de9c-7431-4b9e-8d8c-e6c1f80f3d5d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.629140 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376de9c-7431-4b9e-8d8c-e6c1f80f3d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.629424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376de9c-7431-4b9e-8d8c-e6c1f80f3d5d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.637646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376de9c-7431-4b9e-8d8c-e6c1f80f3d5d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.639153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376de9c-7431-4b9e-8d8c-e6c1f80f3d5d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-d376de9c-7431-4b9e-8d8c-e6c1f80f3d5d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:27:50.652385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:50.653485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 15:27:50.654552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:50.657975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 480/982] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:27:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:50.659729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724e232-592a-4ca0-9941-edd25175b2b5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.768079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724e232-592a-4ca0-9941-edd25175b2b5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:50.810294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb81cc6-9e32-40d9-b4e0-3b0fe281ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:50.810916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb81cc6-9e32-40d9-b4e0-3b0fe281ce58 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:50.811224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb81cc6-9e32-40d9-b4e0-3b0fe281ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:50.811497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb81cc6-9e32-40d9-b4e0-3b0fe281ce58 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:50.812815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb81cc6-9e32-40d9-b4e0-3b0fe281ce58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:50.813139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb81cc6-9e32-40d9-b4e0-3b0fe281ce58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:50.814565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb81cc6-9e32-40d9-b4e0-3b0fe281ce58 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:50.833502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 503/983] 10.222.0.89 () {56 vars in 1149 bytes} [Fri Aug 26 15:27:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:50.842924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376de9c-7431-4b9e-8d8c-e6c1f80f3d5d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:50.913734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:50.975814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376de9c-7431-4b9e-8d8c-e6c1f80f3d5d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.012365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c3021-f743-414e-8607-ea688e4abd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.012985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c3021-f743-414e-8607-ea688e4abd48 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.013266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c3021-f743-414e-8607-ea688e4abd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.013541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c3021-f743-414e-8607-ea688e4abd48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.083696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c3021-f743-414e-8607-ea688e4abd48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.085153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c3021-f743-414e-8607-ea688e4abd48 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.126524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.186661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 481/984] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:27:50 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:27:51.192124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb81cc6-9e32-40d9-b4e0-3b0fe281ce58 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.211411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.303566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb81cc6-9e32-40d9-b4e0-3b0fe281ce58 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.348229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a36a64-cfb4-4929-afd1-609954c21a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.349123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a36a64-cfb4-4929-afd1-609954c21a52 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.349595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a36a64-cfb4-4929-afd1-609954c21a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.350040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a36a64-cfb4-4929-afd1-609954c21a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.361270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a36a64-cfb4-4929-afd1-609954c21a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.362855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a36a64-cfb4-4929-afd1-609954c21a52 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-c4a36a64-cfb4-4929-afd1-609954c21a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:51.377989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:51.379193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:51.380258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:51.380258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:51.380258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:51.381491 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 504/985] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:51.386975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c3021-f743-414e-8607-ea688e4abd48 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.488023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c3021-f743-414e-8607-ea688e4abd48 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.521496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eefa35-f939-472a-b6ac-e3005cd0b7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.522107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eefa35-f939-472a-b6ac-e3005cd0b7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.522393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eefa35-f939-472a-b6ac-e3005cd0b7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.522667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eefa35-f939-472a-b6ac-e3005cd0b7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.523340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eefa35-f939-472a-b6ac-e3005cd0b7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:51.523650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eefa35-f939-472a-b6ac-e3005cd0b7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.525110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eefa35-f939-472a-b6ac-e3005cd0b7a6 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.533542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.542303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 482/986] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:51.543587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a36a64-cfb4-4929-afd1-609954c21a52 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.627808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:51.686815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a36a64-cfb4-4929-afd1-609954c21a52 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.721793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef44db3-7646-4b4f-9273-53f791aee311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.722418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef44db3-7646-4b4f-9273-53f791aee311 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.722692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef44db3-7646-4b4f-9273-53f791aee311 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.723033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef44db3-7646-4b4f-9273-53f791aee311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.729739 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef44db3-7646-4b4f-9273-53f791aee311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.731207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef44db3-7646-4b4f-9273-53f791aee311 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-fef44db3-7646-4b4f-9273-53f791aee311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:27:51.742666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:51.748334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:51.749333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:27:51.749333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:27:51.749333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:27:51.749333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:27:51.749333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:27:51.749333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:27:51.749333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:27:51.749333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:51.749333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 505/987] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:51.749818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eefa35-f939-472a-b6ac-e3005cd0b7a6 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:51.856529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eefa35-f939-472a-b6ac-e3005cd0b7a6 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:51.897094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7152ae-2896-4bf5-86bd-16beb943ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:51.897705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7152ae-2896-4bf5-86bd-16beb943ad6c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:51.897989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7152ae-2896-4bf5-86bd-16beb943ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:51.898262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7152ae-2896-4bf5-86bd-16beb943ad6c None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:51.899082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7152ae-2896-4bf5-86bd-16beb943ad6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:51.899392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7152ae-2896-4bf5-86bd-16beb943ad6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:51.900814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7152ae-2896-4bf5-86bd-16beb943ad6c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:51.913766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 483/988] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:51.919623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef44db3-7646-4b4f-9273-53f791aee311 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:52.030731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef44db3-7646-4b4f-9273-53f791aee311 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:52.062597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:52.069588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcc8be-48ae-4c4a-93e8-0286e8ec0025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:52.070203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcc8be-48ae-4c4a-93e8-0286e8ec0025 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.070485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcc8be-48ae-4c4a-93e8-0286e8ec0025 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.070761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcc8be-48ae-4c4a-93e8-0286e8ec0025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.071539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcc8be-48ae-4c4a-93e8-0286e8ec0025 None admin] RBAC: Adding query filter params (role.id=d054d237c41c4a96b795919b8532cda1, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=b91335b29d0b43d5993c44a3e40d4a5b) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:52.071849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcc8be-48ae-4c4a-93e8-0286e8ec0025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:52.073282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcc8be-48ae-4c4a-93e8-0286e8ec0025 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:52.079473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 506/989] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:27:51 2022] GET /identity/v3/role_assignments?user.id=b91335b29d0b43d5993c44a3e40d4a5b&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=d054d237c41c4a96b795919b8532cda1 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:52.289362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98e2c-dbfb-49b2-ab9d-30cc59d912ca None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.289550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98e2c-dbfb-49b2-ab9d-30cc59d912ca None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.289833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98e2c-dbfb-49b2-ab9d-30cc59d912ca None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.291423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 484/990] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:52.297127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf227b79-96b4-478d-8821-cc2cdc56b7e1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.297402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf227b79-96b4-478d-8821-cc2cdc56b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.297679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf227b79-96b4-478d-8821-cc2cdc56b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.317153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cf227b79-96b4-478d-8821-cc2cdc56b7e1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:52.318390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cf227b79-96b4-478d-8821-cc2cdc56b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:52.388772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 507/991] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:52.557583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c35fa-f4a6-4a08-9128-499205322cf2 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.557886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c35fa-f4a6-4a08-9128-499205322cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.558180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c35fa-f4a6-4a08-9128-499205322cf2 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.559658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 485/992] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:52.566814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3919-de73-425e-a646-9dd54fff8834 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.567407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3919-de73-425e-a646-9dd54fff8834 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.567691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3919-de73-425e-a646-9dd54fff8834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.591259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-06ee3919-de73-425e-a646-9dd54fff8834 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:52.592717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-06ee3919-de73-425e-a646-9dd54fff8834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:52.670262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 508/993] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:52.673825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c35fa-f4a6-4a08-9128-499205322cf2 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:52.737938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:52.780524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c35fa-f4a6-4a08-9128-499205322cf2 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:52.820423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a758c46-f3e5-471e-9b9d-009ae0964eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:52.821001 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a758c46-f3e5-471e-9b9d-009ae0964eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.821285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a758c46-f3e5-471e-9b9d-009ae0964eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.821563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a758c46-f3e5-471e-9b9d-009ae0964eb4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.822153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a758c46-f3e5-471e-9b9d-009ae0964eb4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:52.823575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a758c46-f3e5-471e-9b9d-009ae0964eb4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-5a758c46-f3e5-471e-9b9d-009ae0964eb4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:52.832416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:52.833461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 15:27:52.834302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:52.835791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 486/994] 10.222.0.89 () {56 vars in 1126 bytes} [Fri Aug 26 15:27:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:52.839510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3919-de73-425e-a646-9dd54fff8834 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:52.896087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:52.942983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3919-de73-425e-a646-9dd54fff8834 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:52.976186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a758c46-f3e5-471e-9b9d-009ae0964eb4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:52.978218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eebbf-ada5-4498-b367-895b5e05c245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:52.978844 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eebbf-ada5-4498-b367-895b5e05c245 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:52.979157 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eebbf-ada5-4498-b367-895b5e05c245 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:52.979432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eebbf-ada5-4498-b367-895b5e05c245 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:52.980083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eebbf-ada5-4498-b367-895b5e05c245 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:52.980396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eebbf-ada5-4498-b367-895b5e05c245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:52.981760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eebbf-ada5-4498-b367-895b5e05c245 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:52.987646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 509/995] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:52.993023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eebbf-ada5-4498-b367-895b5e05c245 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.097031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a758c46-f3e5-471e-9b9d-009ae0964eb4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.116501 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eebbf-ada5-4498-b367-895b5e05c245 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.123182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:53.135602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:53.137250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7a5ef-73c6-4a65-98d3-5d893dc4a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.137889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7a5ef-73c6-4a65-98d3-5d893dc4a0ec None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.138173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7a5ef-73c6-4a65-98d3-5d893dc4a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.138445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7a5ef-73c6-4a65-98d3-5d893dc4a0ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.139380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7a5ef-73c6-4a65-98d3-5d893dc4a0ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.141601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7a5ef-73c6-4a65-98d3-5d893dc4a0ec None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-07a7a5ef-73c6-4a65-98d3-5d893dc4a0ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:53.150805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:53.152547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:53.153720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 487/996] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:53.157299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8a4b-cfc4-4052-83fd-9a8a0adf7725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.157759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7a5ef-73c6-4a65-98d3-5d893dc4a0ec None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.158045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8a4b-cfc4-4052-83fd-9a8a0adf7725 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.158394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8a4b-cfc4-4052-83fd-9a8a0adf7725 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.158738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8a4b-cfc4-4052-83fd-9a8a0adf7725 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.159471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a8a4b-cfc4-4052-83fd-9a8a0adf7725 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:53.159848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a8a4b-cfc4-4052-83fd-9a8a0adf7725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.161286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a8a4b-cfc4-4052-83fd-9a8a0adf7725 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.166485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 510/997] 10.222.0.89 () {56 vars in 1122 bytes} [Fri Aug 26 15:27:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:53.171966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8a4b-cfc4-4052-83fd-9a8a0adf7725 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.267792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7a5ef-73c6-4a65-98d3-5d893dc4a0ec None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.273735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8a4b-cfc4-4052-83fd-9a8a0adf7725 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.306503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15158a-8c6b-4e12-a525-71874090dc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.307398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15158a-8c6b-4e12-a525-71874090dc2d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.307981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15158a-8c6b-4e12-a525-71874090dc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.308394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15158a-8c6b-4e12-a525-71874090dc2d None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.309066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301eb00-94f5-429f-8f79-6e56788819d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.309345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15158a-8c6b-4e12-a525-71874090dc2d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:53.309671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301eb00-94f5-429f-8f79-6e56788819d5 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.309946 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301eb00-94f5-429f-8f79-6e56788819d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.310092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15158a-8c6b-4e12-a525-71874090dc2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.310219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301eb00-94f5-429f-8f79-6e56788819d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.310877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301eb00-94f5-429f-8f79-6e56788819d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.311968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15158a-8c6b-4e12-a525-71874090dc2d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.312277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301eb00-94f5-429f-8f79-6e56788819d5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.317709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 488/998] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:53.324049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15158a-8c6b-4e12-a525-71874090dc2d None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.332653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 511/999] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:53.391693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:53.452976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15158a-8c6b-4e12-a525-71874090dc2d None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.498778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4b0e3-7dcf-479f-aee8-23292ebb54e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.499458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4b0e3-7dcf-479f-aee8-23292ebb54e8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.499736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4b0e3-7dcf-479f-aee8-23292ebb54e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.500010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4b0e3-7dcf-479f-aee8-23292ebb54e8 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.500650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4b0e3-7dcf-479f-aee8-23292ebb54e8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:53.500954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4b0e3-7dcf-479f-aee8-23292ebb54e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.502316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4b0e3-7dcf-479f-aee8-23292ebb54e8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.507872 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 489/1000] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:53.514244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301eb00-94f5-429f-8f79-6e56788819d5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.561128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:53.625226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301eb00-94f5-429f-8f79-6e56788819d5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.660101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763816fc-ce06-4d25-ae91-bb99a5bd3c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.660625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763816fc-ce06-4d25-ae91-bb99a5bd3c6d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.660900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763816fc-ce06-4d25-ae91-bb99a5bd3c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.661169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763816fc-ce06-4d25-ae91-bb99a5bd3c6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.661940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763816fc-ce06-4d25-ae91-bb99a5bd3c6d None admin] RBAC: Adding query filter params (interface=public, service_id=8db52b37155849a48c3b854d98984a79, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:53.662245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763816fc-ce06-4d25-ae91-bb99a5bd3c6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.663627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763816fc-ce06-4d25-ae91-bb99a5bd3c6d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.668946 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 512/1001] 10.222.0.89 () {56 vars in 1251 bytes} [Fri Aug 26 15:27:53 2022] GET /identity/v3/endpoints?service_id=8db52b37155849a48c3b854d98984a79&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:53.674748 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4b0e3-7dcf-479f-aee8-23292ebb54e8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:53.773432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4b0e3-7dcf-479f-aee8-23292ebb54e8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:53.788404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:53.812731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0a90a-6b93-4355-b9bf-0b68c124deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:53.813477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a90a-6b93-4355-b9bf-0b68c124deb7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:53.813855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a90a-6b93-4355-b9bf-0b68c124deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:53.814861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0a90a-6b93-4355-b9bf-0b68c124deb7 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:53.814861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0a90a-6b93-4355-b9bf-0b68c124deb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:53.817124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0a90a-6b93-4355-b9bf-0b68c124deb7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:53.824192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 490/1002] 10.222.0.89 () {56 vars in 1087 bytes} [Fri Aug 26 15:27:53 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:27:54.059797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b962d-497a-4120-ae94-19a5c7d0eb31 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.060345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b962d-497a-4120-ae94-19a5c7d0eb31 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.060629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b962d-497a-4120-ae94-19a5c7d0eb31 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.062641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 513/1003] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:54.068564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf87a41-58df-4231-8dba-131dfc1829dd None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.069044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf87a41-58df-4231-8dba-131dfc1829dd None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.069625 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf87a41-58df-4231-8dba-131dfc1829dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.090063 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-daf87a41-58df-4231-8dba-131dfc1829dd None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:54.091450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-daf87a41-58df-4231-8dba-131dfc1829dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:54.172460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 491/1004] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:54.443231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b962d-497a-4120-ae94-19a5c7d0eb31 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.562879 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b962d-497a-4120-ae94-19a5c7d0eb31 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.569641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:54.597469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0951f2-6eb3-421e-af9c-363c38cbcace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.598095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0951f2-6eb3-421e-af9c-363c38cbcace None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.598372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0951f2-6eb3-421e-af9c-363c38cbcace None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.598642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0951f2-6eb3-421e-af9c-363c38cbcace None admin] PATH_INFO: `/v3/services/image` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.599253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0951f2-6eb3-421e-af9c-363c38cbcace None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.600594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0951f2-6eb3-421e-af9c-363c38cbcace None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-6b0951f2-6eb3-421e-af9c-363c38cbcace None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:54.609070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:54.610056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:27:54.610895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:54.615221 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 514/1005] 10.222.0.89 () {56 vars in 1105 bytes} [Fri Aug 26 15:27:54 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:54.616452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf87a41-58df-4231-8dba-131dfc1829dd None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.719383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf87a41-58df-4231-8dba-131dfc1829dd None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.728255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:54.762210 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e58951-65e5-4128-b5dc-c3d3572b6562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.762829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58951-65e5-4128-b5dc-c3d3572b6562 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.763159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58951-65e5-4128-b5dc-c3d3572b6562 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.763441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e58951-65e5-4128-b5dc-c3d3572b6562 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.764160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e58951-65e5-4128-b5dc-c3d3572b6562 None admin] RBAC: Adding query filter params (name=image) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:54.764470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e58951-65e5-4128-b5dc-c3d3572b6562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.766147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e58951-65e5-4128-b5dc-c3d3572b6562 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.776172 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 492/1006] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:54.777969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0951f2-6eb3-421e-af9c-363c38cbcace None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:54.888540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0951f2-6eb3-421e-af9c-363c38cbcace None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:54.925377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19327108-ff17-4d01-a986-0670b6461eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:54.926163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19327108-ff17-4d01-a986-0670b6461eeb None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:54.926543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19327108-ff17-4d01-a986-0670b6461eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:54.926945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19327108-ff17-4d01-a986-0670b6461eeb None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:54.927712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19327108-ff17-4d01-a986-0670b6461eeb None admin] RBAC: Adding query filter params (type=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:54.928113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19327108-ff17-4d01-a986-0670b6461eeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:54.929593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19327108-ff17-4d01-a986-0670b6461eeb None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:54.943034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 515/1007] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:55.310256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6f9e4-5b96-44ad-8bac-bde5b2e3fbd8 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:55.310800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6f9e4-5b96-44ad-8bac-bde5b2e3fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:55.310800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6f9e4-5b96-44ad-8bac-bde5b2e3fbd8 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:55.312335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 493/1008] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:27:55.317429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5a156-3cb1-4363-8657-fe2b43fb6192 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:55.317833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5a156-3cb1-4363-8657-fe2b43fb6192 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:55.317980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5a156-3cb1-4363-8657-fe2b43fb6192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:55.336276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c7c5a156-3cb1-4363-8657-fe2b43fb6192 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:55.337475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c7c5a156-3cb1-4363-8657-fe2b43fb6192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:55.365888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:55.416672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 516/1009] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:55 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:55.688842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6f9e4-5b96-44ad-8bac-bde5b2e3fbd8 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:55.765976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d761901-64ff-44f2-818b-3cb3fe64df3b None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:55.766261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d761901-64ff-44f2-818b-3cb3fe64df3b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:55.766539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d761901-64ff-44f2-818b-3cb3fe64df3b None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:55.768040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 517/1010] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:55.772845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d892f-0fb8-48c2-a75e-d31cc9674f7f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:55.773133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d892f-0fb8-48c2-a75e-d31cc9674f7f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:55.773409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d892f-0fb8-48c2-a75e-d31cc9674f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:55.798068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-379d892f-0fb8-48c2-a75e-d31cc9674f7f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:55.798068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-379d892f-0fb8-48c2-a75e-d31cc9674f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:55.806920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6f9e4-5b96-44ad-8bac-bde5b2e3fbd8 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:55.851030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bacbd-9daf-4cc1-a3ca-33d94533a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:55.851677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bacbd-9daf-4cc1-a3ca-33d94533a98e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:55.851963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bacbd-9daf-4cc1-a3ca-33d94533a98e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:55.852232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bacbd-9daf-4cc1-a3ca-33d94533a98e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:55.853362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bacbd-9daf-4cc1-a3ca-33d94533a98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:55.855171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bacbd-9daf-4cc1-a3ca-33d94533a98e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:55.856773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 494/1011] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:55.862924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bacbd-9daf-4cc1-a3ca-33d94533a98e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:55.886980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 518/1012] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:55 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:55.928534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:55.990456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bacbd-9daf-4cc1-a3ca-33d94533a98e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:56.024434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b3852-23ea-45e6-968f-5460b3c17728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:56.025062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b3852-23ea-45e6-968f-5460b3c17728 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.025340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b3852-23ea-45e6-968f-5460b3c17728 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.025609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b3852-23ea-45e6-968f-5460b3c17728 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.026267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b3852-23ea-45e6-968f-5460b3c17728 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:56.027954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b3852-23ea-45e6-968f-5460b3c17728 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:56.062965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 495/1013] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:55 2022] POST /identity/v3/projects => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:56.149752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d892f-0fb8-48c2-a75e-d31cc9674f7f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:56.249482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:56.258019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d892f-0fb8-48c2-a75e-d31cc9674f7f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:56.292669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051308a9-84f2-4009-9cd6-35fa572f46a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:56.293312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051308a9-84f2-4009-9cd6-35fa572f46a3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.293592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051308a9-84f2-4009-9cd6-35fa572f46a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.293885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051308a9-84f2-4009-9cd6-35fa572f46a3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.294452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051308a9-84f2-4009-9cd6-35fa572f46a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:56.295854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051308a9-84f2-4009-9cd6-35fa572f46a3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-051308a9-84f2-4009-9cd6-35fa572f46a3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:56.305316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:56.306513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:56.307548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 519/1014] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:27:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:56.312507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b3852-23ea-45e6-968f-5460b3c17728 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:56.408143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:56.420279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b3852-23ea-45e6-968f-5460b3c17728 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:56.456456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237afe1f-e590-419b-9922-9453e721ebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:56.457061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237afe1f-e590-419b-9922-9453e721ebb4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.457346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237afe1f-e590-419b-9922-9453e721ebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.457619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237afe1f-e590-419b-9922-9453e721ebb4 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.458250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237afe1f-e590-419b-9922-9453e721ebb4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:56.458549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237afe1f-e590-419b-9922-9453e721ebb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:56.460017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237afe1f-e590-419b-9922-9453e721ebb4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:56.470248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 496/1015] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:56.471798 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051308a9-84f2-4009-9cd6-35fa572f46a3 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:56.601081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051308a9-84f2-4009-9cd6-35fa572f46a3 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:56.634802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1d453-b081-45b9-8b57-9769dec4e6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:56.635439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d453-b081-45b9-8b57-9769dec4e6dd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.635716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d453-b081-45b9-8b57-9769dec4e6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.635985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d453-b081-45b9-8b57-9769dec4e6dd None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.636656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1d453-b081-45b9-8b57-9769dec4e6dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:56.636957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1d453-b081-45b9-8b57-9769dec4e6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:56.638307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1d453-b081-45b9-8b57-9769dec4e6dd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:56.648176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 520/1016] 10.222.0.89 () {56 vars in 1112 bytes} [Fri Aug 26 15:27:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:56.649837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237afe1f-e590-419b-9922-9453e721ebb4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:56.753088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237afe1f-e590-419b-9922-9453e721ebb4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:56.792883 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d15a1-70b3-49d6-93d1-19ed8a666fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:56.793490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d15a1-70b3-49d6-93d1-19ed8a666fed None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.793765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d15a1-70b3-49d6-93d1-19ed8a666fed None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.794038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d15a1-70b3-49d6-93d1-19ed8a666fed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.795515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d15a1-70b3-49d6-93d1-19ed8a666fed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:56.797841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d15a1-70b3-49d6-93d1-19ed8a666fed None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:56.818873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 497/1017] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:27:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:27:56.871700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e27c78-514d-4f80-9d63-22d7811b9ce6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.871914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e27c78-514d-4f80-9d63-22d7811b9ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.872620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e27c78-514d-4f80-9d63-22d7811b9ce6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.875301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 521/1018] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:56.881366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf5cc0-2dc7-4b4f-985a-f0fd26a9d7c2 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:56.881663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf5cc0-2dc7-4b4f-985a-f0fd26a9d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:56.881923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf5cc0-2dc7-4b4f-985a-f0fd26a9d7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:56.902101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-9aaf5cc0-2dc7-4b4f-985a-f0fd26a9d7c2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:56.903401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9aaf5cc0-2dc7-4b4f-985a-f0fd26a9d7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:56.907380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:56.983949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 498/1019] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:56 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:57.261291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e27c78-514d-4f80-9d63-22d7811b9ce6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:57.288444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:57.366743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e27c78-514d-4f80-9d63-22d7811b9ce6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:57.400055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5216a-45ee-4799-bb2a-7ccebcaa5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:57.400663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5216a-45ee-4799-bb2a-7ccebcaa5d45 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:57.400937 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5216a-45ee-4799-bb2a-7ccebcaa5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:57.401204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5216a-45ee-4799-bb2a-7ccebcaa5d45 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:57.401861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5216a-45ee-4799-bb2a-7ccebcaa5d45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:57.403268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5216a-45ee-4799-bb2a-7ccebcaa5d45 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:57.428473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 522/1020] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:27:57 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:58.012558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c7e81-90de-416e-90a0-7c8b52ccb539 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:58.013105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c7e81-90de-416e-90a0-7c8b52ccb539 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:58.013105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c7e81-90de-416e-90a0-7c8b52ccb539 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:58.014485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 499/1021] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:58.020208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74028d4-6e90-4c0c-b7a3-c9a74d7f773f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:58.020597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74028d4-6e90-4c0c-b7a3-c9a74d7f773f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:58.020772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74028d4-6e90-4c0c-b7a3-c9a74d7f773f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:58.039137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b74028d4-6e90-4c0c-b7a3-c9a74d7f773f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:58.040326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b74028d4-6e90-4c0c-b7a3-c9a74d7f773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:58.131428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 523/1022] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:58.399555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c7e81-90de-416e-90a0-7c8b52ccb539 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:58.514620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c7e81-90de-416e-90a0-7c8b52ccb539 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:58.556759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9cf03-cb00-45f2-afa5-ea97d3719113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:58.557397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9cf03-cb00-45f2-afa5-ea97d3719113 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:58.557674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9cf03-cb00-45f2-afa5-ea97d3719113 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:58.557942 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9cf03-cb00-45f2-afa5-ea97d3719113 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:58.559151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9cf03-cb00-45f2-afa5-ea97d3719113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:58.560587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9cf03-cb00-45f2-afa5-ea97d3719113 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:58.562854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 500/1023] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:58.568366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74028d4-6e90-4c0c-b7a3-c9a74d7f773f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:58.579253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:58.669205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74028d4-6e90-4c0c-b7a3-c9a74d7f773f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:58.701924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ce328-e793-4464-8dd6-4e2af2d68d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:58.703093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ce328-e793-4464-8dd6-4e2af2d68d3c None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:58.703368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ce328-e793-4464-8dd6-4e2af2d68d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:58.703633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ce328-e793-4464-8dd6-4e2af2d68d3c None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:58.704276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ce328-e793-4464-8dd6-4e2af2d68d3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:58.705683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ce328-e793-4464-8dd6-4e2af2d68d3c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:58.727224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 524/1024] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:27:58 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:27:58.896137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5bc67-be00-49c4-8fa3-6d39c9cd348f None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:58.896454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5bc67-be00-49c4-8fa3-6d39c9cd348f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:58.896700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5bc67-be00-49c4-8fa3-6d39c9cd348f None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:58.898045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 501/1025] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:58.903377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7039e0-f875-461b-a8ef-879a079ca948 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:58.903672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7039e0-f875-461b-a8ef-879a079ca948 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:58.903943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7039e0-f875-461b-a8ef-879a079ca948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:58.923506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2e7039e0-f875-461b-a8ef-879a079ca948 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:58.924623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2e7039e0-f875-461b-a8ef-879a079ca948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:58.990482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:59.000962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 525/1026] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:27:59.267050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5bc67-be00-49c4-8fa3-6d39c9cd348f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:59.271244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:59.388556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5bc67-be00-49c4-8fa3-6d39c9cd348f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:59.411859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa278788-17fc-4319-99fa-83d8b9fbede0 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.412373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa278788-17fc-4319-99fa-83d8b9fbede0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.412478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa278788-17fc-4319-99fa-83d8b9fbede0 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.413950 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 526/1027] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:27:59.419138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae49b2-6f9b-4022-9eb0-fa9fa07b8428 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.419545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae49b2-6f9b-4022-9eb0-fa9fa07b8428 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.419704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae49b2-6f9b-4022-9eb0-fa9fa07b8428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.429554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd2aa5-0832-4e48-9ee7-72fcd3abbdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:59.430187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd2aa5-0832-4e48-9ee7-72fcd3abbdac None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.430463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd2aa5-0832-4e48-9ee7-72fcd3abbdac None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.430729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd2aa5-0832-4e48-9ee7-72fcd3abbdac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.439437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6fae49b2-6f9b-4022-9eb0-fa9fa07b8428 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:27:59.440639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6fae49b2-6f9b-4022-9eb0-fa9fa07b8428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:27:59.442528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd2aa5-0832-4e48-9ee7-72fcd3abbdac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-5ecd2aa5-0832-4e48-9ee7-72fcd3abbdac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:27:59.447219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:59.448173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:27:59.449018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:27:59.453356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 502/1028] 10.222.0.89 () {56 vars in 1120 bytes} [Fri Aug 26 15:27:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:59.454215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd2aa5-0832-4e48-9ee7-72fcd3abbdac None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:59.511942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 527/1029] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:27:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:27:59.519523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:59.558915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd2aa5-0832-4e48-9ee7-72fcd3abbdac None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:59.593923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5303d4-57a0-452f-b8ef-acaccc4a02a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:59.594527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5303d4-57a0-452f-b8ef-acaccc4a02a1 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.594804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5303d4-57a0-452f-b8ef-acaccc4a02a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.595114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5303d4-57a0-452f-b8ef-acaccc4a02a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.595775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5303d4-57a0-452f-b8ef-acaccc4a02a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:59.596077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5303d4-57a0-452f-b8ef-acaccc4a02a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:59.597441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5303d4-57a0-452f-b8ef-acaccc4a02a1 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:59.610216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 503/1030] 10.222.0.89 () {56 vars in 1115 bytes} [Fri Aug 26 15:27:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:27:59.612026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae49b2-6f9b-4022-9eb0-fa9fa07b8428 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:59.723710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae49b2-6f9b-4022-9eb0-fa9fa07b8428 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:59.749291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:59.765890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420b01-53d2-4234-89c0-aa436fd48b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:59.767011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420b01-53d2-4234-89c0-aa436fd48b48 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.767510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420b01-53d2-4234-89c0-aa436fd48b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.767993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420b01-53d2-4234-89c0-aa436fd48b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.786645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420b01-53d2-4234-89c0-aa436fd48b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:59.788125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420b01-53d2-4234-89c0-aa436fd48b48 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-82420b01-53d2-4234-89c0-aa436fd48b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:27:59.806300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:59.807287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:27:59.808296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:27:59.808296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:27:59.808296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:59.808296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 528/1031] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:27:59.813716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5303d4-57a0-452f-b8ef-acaccc4a02a1 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:59.816531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420b01-53d2-4234-89c0-aa436fd48b48 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:59.928744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5303d4-57a0-452f-b8ef-acaccc4a02a1 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:59.930366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420b01-53d2-4234-89c0-aa436fd48b48 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:27:59.963003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:27:59.972432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ada481-eddd-4651-870b-c28cc1467dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:59.973044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ada481-eddd-4651-870b-c28cc1467dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.973328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ada481-eddd-4651-870b-c28cc1467dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.973602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ada481-eddd-4651-870b-c28cc1467dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.974254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ada481-eddd-4651-870b-c28cc1467dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:27:59.974561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ada481-eddd-4651-870b-c28cc1467dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:59.975944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ada481-eddd-4651-870b-c28cc1467dd3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:59.977280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9013c-55dc-4dc4-ae96-2a455108711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:27:59.977982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9013c-55dc-4dc4-ae96-2a455108711d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:27:59.978596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9013c-55dc-4dc4-ae96-2a455108711d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:27:59.978705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9013c-55dc-4dc4-ae96-2a455108711d None admin] PATH_INFO: `/v3/services/image` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:27:59.979244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9013c-55dc-4dc4-ae96-2a455108711d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:27:59.980590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9013c-55dc-4dc4-ae96-2a455108711d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:27:59.987940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 504/1032] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d5c9013c-55dc-4dc4-ae96-2a455108711d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:27:59.989815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:27:59.990762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:27:59.995638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 529/1033] 10.222.0.89 () {56 vars in 1105 bytes} [Fri Aug 26 15:27:59 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:27:59.996836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ada481-eddd-4651-870b-c28cc1467dd3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:27:59.997201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9013c-55dc-4dc4-ae96-2a455108711d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.048205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.112080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ada481-eddd-4651-870b-c28cc1467dd3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.116659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9013c-55dc-4dc4-ae96-2a455108711d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.158685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb329da-a954-4d12-b8af-8bd3096f4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.159327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb329da-a954-4d12-b8af-8bd3096f4377 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.159607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb329da-a954-4d12-b8af-8bd3096f4377 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.159927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb329da-a954-4d12-b8af-8bd3096f4377 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.160561 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb329da-a954-4d12-b8af-8bd3096f4377 None admin] RBAC: Adding query filter params (name=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:00.160812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb329da-a954-4d12-b8af-8bd3096f4377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.161290 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14b6b5-6ff4-4313-b0a4-67f56e6ac5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.161988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14b6b5-6ff4-4313-b0a4-67f56e6ac5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.162177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb329da-a954-4d12-b8af-8bd3096f4377 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.162392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14b6b5-6ff4-4313-b0a4-67f56e6ac5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.162737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14b6b5-6ff4-4313-b0a4-67f56e6ac5e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.167591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 530/1034] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:27:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:00.170250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14b6b5-6ff4-4313-b0a4-67f56e6ac5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.171746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14b6b5-6ff4-4313-b0a4-67f56e6ac5e5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.173101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb329da-a954-4d12-b8af-8bd3096f4377 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-0e14b6b5-6ff4-4313-b0a4-67f56e6ac5e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:28:00.185842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:00.187372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:00.188410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:00.189752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 505/1035] 10.222.0.89 () {56 vars in 1093 bytes} [Fri Aug 26 15:27:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:00.193508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14b6b5-6ff4-4313-b0a4-67f56e6ac5e5 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.244377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.288086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb329da-a954-4d12-b8af-8bd3096f4377 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.291904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.311254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14b6b5-6ff4-4313-b0a4-67f56e6ac5e5 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.330307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39cf57-01b8-44f1-be72-471f1d68a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.330922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39cf57-01b8-44f1-be72-471f1d68a617 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.331225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39cf57-01b8-44f1-be72-471f1d68a617 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.331494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39cf57-01b8-44f1-be72-471f1d68a617 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.332563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39cf57-01b8-44f1-be72-471f1d68a617 None admin] RBAC: Adding query filter params (type=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:00.332867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39cf57-01b8-44f1-be72-471f1d68a617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.334432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39cf57-01b8-44f1-be72-471f1d68a617 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.340929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 531/1036] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:00.346669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19543096-fe52-458e-a2a7-83ee2bc2f450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.346827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39cf57-01b8-44f1-be72-471f1d68a617 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.347374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19543096-fe52-458e-a2a7-83ee2bc2f450 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.347655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19543096-fe52-458e-a2a7-83ee2bc2f450 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.347929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19543096-fe52-458e-a2a7-83ee2bc2f450 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.348659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19543096-fe52-458e-a2a7-83ee2bc2f450 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:00.348966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19543096-fe52-458e-a2a7-83ee2bc2f450 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.350380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19543096-fe52-458e-a2a7-83ee2bc2f450 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.382154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 506/1037] 10.222.0.89 () {56 vars in 1133 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:00.385342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19543096-fe52-458e-a2a7-83ee2bc2f450 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.469151 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39cf57-01b8-44f1-be72-471f1d68a617 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.500983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19543096-fe52-458e-a2a7-83ee2bc2f450 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.504404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.505318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c41092-5cd3-423d-ae51-c13c1a20645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.505928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c41092-5cd3-423d-ae51-c13c1a20645e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.506307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c41092-5cd3-423d-ae51-c13c1a20645e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.506469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c41092-5cd3-423d-ae51-c13c1a20645e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.507209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c41092-5cd3-423d-ae51-c13c1a20645e None admin] RBAC: Adding query filter params (interface=public, service_id=8ae96af07b564e15b0a3c42c44f80dcc, region_id=RegionOne) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:00.507516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c41092-5cd3-423d-ae51-c13c1a20645e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.508873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c41092-5cd3-423d-ae51-c13c1a20645e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.514165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 532/1038] 10.222.0.89 () {56 vars in 1251 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/endpoints?service_id=8ae96af07b564e15b0a3c42c44f80dcc&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:00.520553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c41092-5cd3-423d-ae51-c13c1a20645e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.543565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639980c-eb13-4663-888a-620271cd6fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.544173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639980c-eb13-4663-888a-620271cd6fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.544454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639980c-eb13-4663-888a-620271cd6fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.544728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639980c-eb13-4663-888a-620271cd6fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.561541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.623133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639980c-eb13-4663-888a-620271cd6fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.624852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639980c-eb13-4663-888a-620271cd6fa8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.640869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c41092-5cd3-423d-ae51-c13c1a20645e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.686587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed93374-2fa8-47e8-9436-3c91cbc82bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.687229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed93374-2fa8-47e8-9436-3c91cbc82bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.687506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed93374-2fa8-47e8-9436-3c91cbc82bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.687779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed93374-2fa8-47e8-9436-3c91cbc82bb9 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.688392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed93374-2fa8-47e8-9436-3c91cbc82bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.689734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed93374-2fa8-47e8-9436-3c91cbc82bb9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.696264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 533/1039] 10.222.0.89 () {56 vars in 1087 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:28:00.721770 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545dbc-26a4-46b9-a49e-95da79ced38c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.722078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545dbc-26a4-46b9-a49e-95da79ced38c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.722362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545dbc-26a4-46b9-a49e-95da79ced38c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.724198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 534/1040] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:28:00.730034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4a545-61de-4c22-b370-0ef661299b2e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.730300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4a545-61de-4c22-b370-0ef661299b2e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.730594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4a545-61de-4c22-b370-0ef661299b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.751199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-15a4a545-61de-4c22-b370-0ef661299b2e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:00.752457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-15a4a545-61de-4c22-b370-0ef661299b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:00.760615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 507/1041] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:00.768032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639980c-eb13-4663-888a-620271cd6fa8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.773115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:00.839934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 535/1042] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:00.893549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639980c-eb13-4663-888a-620271cd6fa8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:00.928250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba558d33-ebd3-4c8c-8587-56f2f8be294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:00.928884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba558d33-ebd3-4c8c-8587-56f2f8be294c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:00.929168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba558d33-ebd3-4c8c-8587-56f2f8be294c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:00.929449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba558d33-ebd3-4c8c-8587-56f2f8be294c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:00.941245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba558d33-ebd3-4c8c-8587-56f2f8be294c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:00.942699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba558d33-ebd3-4c8c-8587-56f2f8be294c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-ba558d33-ebd3-4c8c-8587-56f2f8be294c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:00.956857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:00.957875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:00.959497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:00.959497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:00.959497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:00.959497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 508/1043] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:00.963763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4a545-61de-4c22-b370-0ef661299b2e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:00.994189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.104350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4a545-61de-4c22-b370-0ef661299b2e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.108539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba558d33-ebd3-4c8c-8587-56f2f8be294c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.167403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536e3e9-90ec-4afd-aa0f-7819ee86a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.168421 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536e3e9-90ec-4afd-aa0f-7819ee86a58d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.168914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536e3e9-90ec-4afd-aa0f-7819ee86a58d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.169393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536e3e9-90ec-4afd-aa0f-7819ee86a58d None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.170522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536e3e9-90ec-4afd-aa0f-7819ee86a58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:01.171106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536e3e9-90ec-4afd-aa0f-7819ee86a58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.173627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536e3e9-90ec-4afd-aa0f-7819ee86a58d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.178047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.192767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 536/1044] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:01.193851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536e3e9-90ec-4afd-aa0f-7819ee86a58d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.235756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba558d33-ebd3-4c8c-8587-56f2f8be294c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.273039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc0eb0-88a4-412c-a798-309c86a931a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.274036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc0eb0-88a4-412c-a798-309c86a931a4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.274316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc0eb0-88a4-412c-a798-309c86a931a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.274598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc0eb0-88a4-412c-a798-309c86a931a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.286375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc0eb0-88a4-412c-a798-309c86a931a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:01.290707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-ddbc0eb0-88a4-412c-a798-309c86a931a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:01.291125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:01.292051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:01.292916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 509/1045] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:01.298716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc0eb0-88a4-412c-a798-309c86a931a4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.312743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536e3e9-90ec-4afd-aa0f-7819ee86a58d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.357054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c0674-5210-472a-b8d5-92b5d4a317aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.357852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c0674-5210-472a-b8d5-92b5d4a317aa None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.358419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c0674-5210-472a-b8d5-92b5d4a317aa None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.358819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c0674-5210-472a-b8d5-92b5d4a317aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.368419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c0674-5210-472a-b8d5-92b5d4a317aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.370375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c0674-5210-472a-b8d5-92b5d4a317aa None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-0f7c0674-5210-472a-b8d5-92b5d4a317aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:28:01.386623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:01.387750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:01.388807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:28:01.388807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:28:01.388807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:28:01.388807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:28:01.388807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:28:01.388807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:28:01.388807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:01.388807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:01.388807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 537/1046] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:01.395540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c0674-5210-472a-b8d5-92b5d4a317aa None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.403968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc0eb0-88a4-412c-a798-309c86a931a4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.420824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.440744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55924-d7d0-44e0-a70c-1d756b02f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.441386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55924-d7d0-44e0-a70c-1d756b02f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.441636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55924-d7d0-44e0-a70c-1d756b02f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.441909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55924-d7d0-44e0-a70c-1d756b02f1d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.442571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55924-d7d0-44e0-a70c-1d756b02f1d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:01.442874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55924-d7d0-44e0-a70c-1d756b02f1d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.444261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55924-d7d0-44e0-a70c-1d756b02f1d9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.453516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 510/1047] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:01.459311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55924-d7d0-44e0-a70c-1d756b02f1d9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.504569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c0674-5210-472a-b8d5-92b5d4a317aa None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.542608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9908a-4426-46df-afc4-995588e2de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.543249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9908a-4426-46df-afc4-995588e2de68 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.543533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9908a-4426-46df-afc4-995588e2de68 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.543810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9908a-4426-46df-afc4-995588e2de68 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.544509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9908a-4426-46df-afc4-995588e2de68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:01.544816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9908a-4426-46df-afc4-995588e2de68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.546821 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9908a-4426-46df-afc4-995588e2de68 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.559300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 538/1048] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:01.565123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55924-d7d0-44e0-a70c-1d756b02f1d9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.565278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9908a-4426-46df-afc4-995588e2de68 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.574559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.602494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f68099-aef0-4274-8fcd-4d5999621174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.603398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f68099-aef0-4274-8fcd-4d5999621174 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.603840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f68099-aef0-4274-8fcd-4d5999621174 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.604255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f68099-aef0-4274-8fcd-4d5999621174 None admin] PATH_INFO: `/v3/users/b0680d9f4fe64a3a9d06f71001cab929` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.618556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f68099-aef0-4274-8fcd-4d5999621174 None admin] RBAC: Authorizing `identity:get_user(user_id=b0680d9f4fe64a3a9d06f71001cab929)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.620217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f68099-aef0-4274-8fcd-4d5999621174 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.622095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 511/1049] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/users/b0680d9f4fe64a3a9d06f71001cab929 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:01.628441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f68099-aef0-4274-8fcd-4d5999621174 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:01.663812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:01.690006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9908a-4426-46df-afc4-995588e2de68 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.727051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19795059-20ea-4550-9c5a-431d040bea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.727931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19795059-20ea-4550-9c5a-431d040bea6b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.728213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19795059-20ea-4550-9c5a-431d040bea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.728489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19795059-20ea-4550-9c5a-431d040bea6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.729206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19795059-20ea-4550-9c5a-431d040bea6b None admin] RBAC: Adding query filter params (role.id=d054d237c41c4a96b795919b8532cda1, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=5cbda75c38b04e6c89f17e655eb4f737) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:01.729663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19795059-20ea-4550-9c5a-431d040bea6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.731483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19795059-20ea-4550-9c5a-431d040bea6b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.746965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 539/1050] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/role_assignments?user.id=5cbda75c38b04e6c89f17e655eb4f737&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=d054d237c41c4a96b795919b8532cda1 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:01.750029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f68099-aef0-4274-8fcd-4d5999621174 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:01.794784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325fdf-1a0f-430c-896e-538797bd9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:01.795455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325fdf-1a0f-430c-896e-538797bd9f84 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:01.795733 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325fdf-1a0f-430c-896e-538797bd9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:01.796045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325fdf-1a0f-430c-896e-538797bd9f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:01.872934 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325fdf-1a0f-430c-896e-538797bd9f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:01.875020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325fdf-1a0f-430c-896e-538797bd9f84 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:01.912959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:02.016997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 512/1051] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 15:28:02.018912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19795059-20ea-4550-9c5a-431d040bea6b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:02.090325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:02.124290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19795059-20ea-4550-9c5a-431d040bea6b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:02.157858 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b552f7b-ba57-4475-bd1d-f7ccb4cf9448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:02.158494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b552f7b-ba57-4475-bd1d-f7ccb4cf9448 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:02.158772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b552f7b-ba57-4475-bd1d-f7ccb4cf9448 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:02.159072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b552f7b-ba57-4475-bd1d-f7ccb4cf9448 None admin] PATH_INFO: `/v3/projects/3960f599dbb54231b4645651556c0fc7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:02.160214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b552f7b-ba57-4475-bd1d-f7ccb4cf9448 None admin] RBAC: Authorizing `identity:get_project(project_id=3960f599dbb54231b4645651556c0fc7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:02.161637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b552f7b-ba57-4475-bd1d-f7ccb4cf9448 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:02.163463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 540/1052] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:02 2022] GET /identity/v3/projects/3960f599dbb54231b4645651556c0fc7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:02.169584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325fdf-1a0f-430c-896e-538797bd9f84 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:02.275912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325fdf-1a0f-430c-896e-538797bd9f84 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:02.309616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffca6c-e1dc-44cc-94eb-6e91e738f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:02.310221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffca6c-e1dc-44cc-94eb-6e91e738f143 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:02.310499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffca6c-e1dc-44cc-94eb-6e91e738f143 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:02.310774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffca6c-e1dc-44cc-94eb-6e91e738f143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:02.312053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffca6c-e1dc-44cc-94eb-6e91e738f143 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=3960f599dbb54231b4645651556c0fc7, user.id=b0680d9f4fe64a3a9d06f71001cab929) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:02.312364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffca6c-e1dc-44cc-94eb-6e91e738f143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:02.313782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffca6c-e1dc-44cc-94eb-6e91e738f143 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:02.316650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:02.320617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 513/1053] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:02 2022] GET /identity/v3/role_assignments?user.id=b0680d9f4fe64a3a9d06f71001cab929&scope.project.id=3960f599dbb54231b4645651556c0fc7&role.id=609b1a993a394f0e900e17edccebaea5 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:02.668065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3dc03-c0e8-4779-9613-a403dca47a75 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:02.668616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3dc03-c0e8-4779-9613-a403dca47a75 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:02.668616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3dc03-c0e8-4779-9613-a403dca47a75 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:02.669990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 541/1054] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:02.675786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a542ddf-7322-40d2-aee0-eea6c08c8aef None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:02.676192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a542ddf-7322-40d2-aee0-eea6c08c8aef None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:02.676379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a542ddf-7322-40d2-aee0-eea6c08c8aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:02.698778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5a542ddf-7322-40d2-aee0-eea6c08c8aef None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:02.699998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5a542ddf-7322-40d2-aee0-eea6c08c8aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:02.781558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 514/1055] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:03.045754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3dc03-c0e8-4779-9613-a403dca47a75 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:03.150413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3dc03-c0e8-4779-9613-a403dca47a75 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:03.184068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e9a8-24ae-4ea0-99d8-220de7308aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:03.184704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e9a8-24ae-4ea0-99d8-220de7308aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.184982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e9a8-24ae-4ea0-99d8-220de7308aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.185254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e9a8-24ae-4ea0-99d8-220de7308aa2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.185842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568e9a8-24ae-4ea0-99d8-220de7308aa2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:03.187754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568e9a8-24ae-4ea0-99d8-220de7308aa2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e568e9a8-24ae-4ea0-99d8-220de7308aa2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:03.196622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:03.197648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:03.198527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 542/1056] 10.222.0.89 () {56 vars in 1105 bytes} [Fri Aug 26 15:28:03 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:03.204977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a542ddf-7322-40d2-aee0-eea6c08c8aef None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:03.306633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a542ddf-7322-40d2-aee0-eea6c08c8aef None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:03.336043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:03.343587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a946bab-4ad5-4f46-a5e3-7b80be773834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:03.344206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a946bab-4ad5-4f46-a5e3-7b80be773834 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.344488 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a946bab-4ad5-4f46-a5e3-7b80be773834 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.344761 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a946bab-4ad5-4f46-a5e3-7b80be773834 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.345422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a946bab-4ad5-4f46-a5e3-7b80be773834 None admin] RBAC: Adding query filter params (name=image) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:03.345706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a946bab-4ad5-4f46-a5e3-7b80be773834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:03.347137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a946bab-4ad5-4f46-a5e3-7b80be773834 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:03.352230 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 515/1057] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:03.357808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e9a8-24ae-4ea0-99d8-220de7308aa2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:03.361350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:03.469125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568e9a8-24ae-4ea0-99d8-220de7308aa2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:03.502902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dabc3-55df-4782-ad69-587240dc9905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:03.503544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dabc3-55df-4782-ad69-587240dc9905 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.503824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dabc3-55df-4782-ad69-587240dc9905 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.504099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dabc3-55df-4782-ad69-587240dc9905 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.504734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dabc3-55df-4782-ad69-587240dc9905 None admin] RBAC: Adding query filter params (type=image) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:03.505036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dabc3-55df-4782-ad69-587240dc9905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:03.506400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dabc3-55df-4782-ad69-587240dc9905 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:03.511411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 543/1058] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:03.517808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a946bab-4ad5-4f46-a5e3-7b80be773834 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:03.644650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a83e1e-24f6-471a-8b2c-0007bbe8e6c1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.644850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a83e1e-24f6-471a-8b2c-0007bbe8e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.645114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a83e1e-24f6-471a-8b2c-0007bbe8e6c1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.647095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 544/1059] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:03.649200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a946bab-4ad5-4f46-a5e3-7b80be773834 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:03.651429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a12c62-7ab8-425e-ab0e-b9e778b2ad2c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.651711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a12c62-7ab8-425e-ab0e-b9e778b2ad2c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.651982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a12c62-7ab8-425e-ab0e-b9e778b2ad2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.670410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c0a12c62-7ab8-425e-ab0e-b9e778b2ad2c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:03.671665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c0a12c62-7ab8-425e-ab0e-b9e778b2ad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:03.687411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b812b0c-5644-400a-9699-1311d9d97e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:03.688024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b812b0c-5644-400a-9699-1311d9d97e45 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:03.688287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b812b0c-5644-400a-9699-1311d9d97e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:03.688588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b812b0c-5644-400a-9699-1311d9d97e45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:03.689241 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b812b0c-5644-400a-9699-1311d9d97e45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:03.690596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b812b0c-5644-400a-9699-1311d9d97e45 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:03.712160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 516/1060] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:28:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:28:03.759078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:03.775967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 545/1061] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:04.052306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b812b0c-5644-400a-9699-1311d9d97e45 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.104474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.158527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b812b0c-5644-400a-9699-1311d9d97e45 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.194469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2b683-c88e-4b4f-b933-6b4ad18aeafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.194469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b683-c88e-4b4f-b933-6b4ad18aeafc None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.194469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b683-c88e-4b4f-b933-6b4ad18aeafc None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.194469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b683-c88e-4b4f-b933-6b4ad18aeafc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.204913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2b683-c88e-4b4f-b933-6b4ad18aeafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-d6b2b683-c88e-4b4f-b933-6b4ad18aeafc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:04.210046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:04.211016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:04.211871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:04.215279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 517/1062] 10.222.0.89 () {56 vars in 1120 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:04.217501 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a12c62-7ab8-425e-ab0e-b9e778b2ad2c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.243914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9018-a483-431a-83b4-fadcff111247 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.244764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9018-a483-431a-83b4-fadcff111247 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.245180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9018-a483-431a-83b4-fadcff111247 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.247016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 518/1063] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:28:04.252701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bcb6a-67d5-47dd-806f-5e6e4f65d9bb None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.253084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bcb6a-67d5-47dd-806f-5e6e4f65d9bb None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.253459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bcb6a-67d5-47dd-806f-5e6e4f65d9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.276112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f70bcb6a-67d5-47dd-806f-5e6e4f65d9bb None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:04.277300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f70bcb6a-67d5-47dd-806f-5e6e4f65d9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:04.347178 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a12c62-7ab8-425e-ab0e-b9e778b2ad2c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.359286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 519/1064] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:04.383564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7ef7-f069-4b19-9e42-8bcdd3a41483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.384178 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7ef7-f069-4b19-9e42-8bcdd3a41483 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.384458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7ef7-f069-4b19-9e42-8bcdd3a41483 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.384731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7ef7-f069-4b19-9e42-8bcdd3a41483 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.385394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7ef7-f069-4b19-9e42-8bcdd3a41483 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:04.385696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7ef7-f069-4b19-9e42-8bcdd3a41483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:04.387104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7ef7-f069-4b19-9e42-8bcdd3a41483 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:04.399294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 546/1065] 10.222.0.89 () {56 vars in 1115 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:04.401602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bcb6a-67d5-47dd-806f-5e6e4f65d9bb None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.443377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.501984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bcb6a-67d5-47dd-806f-5e6e4f65d9bb None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.536479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afd1ed-c1f4-4419-8b66-4d7eb01e75c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.537106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd1ed-c1f4-4419-8b66-4d7eb01e75c3 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.537389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd1ed-c1f4-4419-8b66-4d7eb01e75c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.537658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd1ed-c1f4-4419-8b66-4d7eb01e75c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.548418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afd1ed-c1f4-4419-8b66-4d7eb01e75c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:04.549850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afd1ed-c1f4-4419-8b66-4d7eb01e75c3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-80afd1ed-c1f4-4419-8b66-4d7eb01e75c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:04.564916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:04.565868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:04.571660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:04.571660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:04.571660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:04.571660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 520/1066] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:04.571899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7ef7-f069-4b19-9e42-8bcdd3a41483 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.625751 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afd1ed-c1f4-4419-8b66-4d7eb01e75c3 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.635162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.692768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7ef7-f069-4b19-9e42-8bcdd3a41483 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.730864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbe0bb-ce87-423f-a686-75bac5b49026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.731516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbe0bb-ce87-423f-a686-75bac5b49026 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.732188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbe0bb-ce87-423f-a686-75bac5b49026 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.732469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbe0bb-ce87-423f-a686-75bac5b49026 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.733281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbe0bb-ce87-423f-a686-75bac5b49026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:04.734135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbe0bb-ce87-423f-a686-75bac5b49026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:04.735697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbe0bb-ce87-423f-a686-75bac5b49026 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:04.742602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.749111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 547/1067] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:04.752332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afd1ed-c1f4-4419-8b66-4d7eb01e75c3 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.754666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbe0bb-ce87-423f-a686-75bac5b49026 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.792188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b340b4-e4a3-424e-afe6-e80a2504089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.792954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b340b4-e4a3-424e-afe6-e80a2504089a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.793229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b340b4-e4a3-424e-afe6-e80a2504089a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.793497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b340b4-e4a3-424e-afe6-e80a2504089a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.811542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b340b4-e4a3-424e-afe6-e80a2504089a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-02b340b4-e4a3-424e-afe6-e80a2504089a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:04.815538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:04.819124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:04.820182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 521/1068] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:04.822270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b340b4-e4a3-424e-afe6-e80a2504089a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.894286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbe0bb-ce87-423f-a686-75bac5b49026 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.910535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:04.933137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00489484-a4d1-4af4-9358-2284c6401d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.933788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00489484-a4d1-4af4-9358-2284c6401d00 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.934067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00489484-a4d1-4af4-9358-2284c6401d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.934338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00489484-a4d1-4af4-9358-2284c6401d00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.941869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00489484-a4d1-4af4-9358-2284c6401d00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:04.943963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00489484-a4d1-4af4-9358-2284c6401d00 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:04.949047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b340b4-e4a3-424e-afe6-e80a2504089a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-00489484-a4d1-4af4-9358-2284c6401d00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:28:04.956083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:04.957043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:04.958016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 548/1069] 10.222.0.89 () {56 vars in 1093 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:04.962890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00489484-a4d1-4af4-9358-2284c6401d00 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:04.987452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32a1e-d82b-4c01-a7fe-088d638918e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:04.988062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32a1e-d82b-4c01-a7fe-088d638918e8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:04.988343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32a1e-d82b-4c01-a7fe-088d638918e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:04.988615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32a1e-d82b-4c01-a7fe-088d638918e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:04.989284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32a1e-d82b-4c01-a7fe-088d638918e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:04.989586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32a1e-d82b-4c01-a7fe-088d638918e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:04.990965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32a1e-d82b-4c01-a7fe-088d638918e8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.006194 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 522/1070] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:05.006865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32a1e-d82b-4c01-a7fe-088d638918e8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.023536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.067925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00489484-a4d1-4af4-9358-2284c6401d00 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.109035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50a20-1b0b-4885-8c4d-6020e84509c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.109756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50a20-1b0b-4885-8c4d-6020e84509c1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.110038 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50a20-1b0b-4885-8c4d-6020e84509c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.110314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed50a20-1b0b-4885-8c4d-6020e84509c1 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.111085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed50a20-1b0b-4885-8c4d-6020e84509c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:05.111398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed50a20-1b0b-4885-8c4d-6020e84509c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.112826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed50a20-1b0b-4885-8c4d-6020e84509c1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.115663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32a1e-d82b-4c01-a7fe-088d638918e8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.133008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 549/1071] 10.222.0.89 () {56 vars in 1133 bytes} [Fri Aug 26 15:28:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:05.138464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50a20-1b0b-4885-8c4d-6020e84509c1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.164173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f9102-d345-4d59-8ee1-f96918ee1a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.164773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f9102-d345-4d59-8ee1-f96918ee1a69 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.165069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f9102-d345-4d59-8ee1-f96918ee1a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.165342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f9102-d345-4d59-8ee1-f96918ee1a69 None admin] PATH_INFO: `/v3/users/b0680d9f4fe64a3a9d06f71001cab929` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.166542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f9102-d345-4d59-8ee1-f96918ee1a69 None admin] RBAC: Authorizing `identity:get_user(user_id=b0680d9f4fe64a3a9d06f71001cab929)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.168008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f9102-d345-4d59-8ee1-f96918ee1a69 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.169755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 523/1072] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/users/b0680d9f4fe64a3a9d06f71001cab929 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:05.174114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.175663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f9102-d345-4d59-8ee1-f96918ee1a69 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.261672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed50a20-1b0b-4885-8c4d-6020e84509c1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.263243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.293220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f9102-d345-4d59-8ee1-f96918ee1a69 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.301729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f8f5d-77ad-48c5-b9d2-af574c5867c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.302386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f8f5d-77ad-48c5-b9d2-af574c5867c1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.303072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f8f5d-77ad-48c5-b9d2-af574c5867c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.303353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f8f5d-77ad-48c5-b9d2-af574c5867c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.315521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f8f5d-77ad-48c5-b9d2-af574c5867c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.316978 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f8f5d-77ad-48c5-b9d2-af574c5867c1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.330530 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a0c52-a20f-4129-b8a2-ac90a47b2795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.331188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a0c52-a20f-4129-b8a2-ac90a47b2795 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.331463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a0c52-a20f-4129-b8a2-ac90a47b2795 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.331739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a0c52-a20f-4129-b8a2-ac90a47b2795 None admin] PATH_INFO: `/v3/projects/3960f599dbb54231b4645651556c0fc7` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-374f8f5d-77ad-48c5-b9d2-af574c5867c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:05.332727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:05.333622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:05.339843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:05.339843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:05.339843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:05.340020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a0c52-a20f-4129-b8a2-ac90a47b2795 None admin] RBAC: Authorizing `identity:get_project(project_id=3960f599dbb54231b4645651556c0fc7)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.340103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 550/1073] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:05.340181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a0c52-a20f-4129-b8a2-ac90a47b2795 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.340181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 524/1074] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/projects/3960f599dbb54231b4645651556c0fc7 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:05.340331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f8f5d-77ad-48c5-b9d2-af574c5867c1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.341800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a0c52-a20f-4129-b8a2-ac90a47b2795 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.428404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.447084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f8f5d-77ad-48c5-b9d2-af574c5867c1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.453660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a0c52-a20f-4129-b8a2-ac90a47b2795 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.487713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c3431-d8ff-4e2c-a02f-16e8a656ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.488437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3431-d8ff-4e2c-a02f-16e8a656ddbf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.488782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3431-d8ff-4e2c-a02f-16e8a656ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.489060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3431-d8ff-4e2c-a02f-16e8a656ddbf None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.489712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c3431-d8ff-4e2c-a02f-16e8a656ddbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:05.490019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c3431-d8ff-4e2c-a02f-16e8a656ddbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.491422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c3431-d8ff-4e2c-a02f-16e8a656ddbf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.494242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda06b4d-f8ab-477c-9276-5cbcbb877f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.494901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06b4d-f8ab-477c-9276-5cbcbb877f3a None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.495211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06b4d-f8ab-477c-9276-5cbcbb877f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.495487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda06b4d-f8ab-477c-9276-5cbcbb877f3a None admin] PATH_INFO: `/v3/projects/3960f599dbb54231b4645651556c0fc7/users/b0680d9f4fe64a3a9d06f71001cab929/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.497381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda06b4d-f8ab-477c-9276-5cbcbb877f3a None admin] RBAC: Authorizing `identity:create_grant(project_id=3960f599dbb54231b4645651556c0fc7, user_id=b0680d9f4fe64a3a9d06f71001cab929, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.498808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda06b4d-f8ab-477c-9276-5cbcbb877f3a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.509768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 551/1075] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:05.511091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c3431-d8ff-4e2c-a02f-16e8a656ddbf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.517076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 525/1076] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:05 2022] PUT /identity/v3/projects/3960f599dbb54231b4645651556c0fc7/users/b0680d9f4fe64a3a9d06f71001cab929/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:28:05.643248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c3431-d8ff-4e2c-a02f-16e8a656ddbf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.685132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5e96f-045a-460b-b6e4-3fce34c710b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.685740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5e96f-045a-460b-b6e4-3fce34c710b9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.686054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5e96f-045a-460b-b6e4-3fce34c710b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.686328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5e96f-045a-460b-b6e4-3fce34c710b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.694796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5e96f-045a-460b-b6e4-3fce34c710b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.697243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5e96f-045a-460b-b6e4-3fce34c710b9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-67f5e96f-045a-460b-b6e4-3fce34c710b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:28:05.709055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:05.710666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:05.712395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:28:05.712395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:28:05.712395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:28:05.712395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:28:05.712395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:28:05.712395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:28:05.712395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:05.712395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:05.712395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 552/1077] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:05.715027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02bd5-ae7e-4967-a925-967a7856f964 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.715327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02bd5-ae7e-4967-a925-967a7856f964 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.715604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02bd5-ae7e-4967-a925-967a7856f964 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.715813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5e96f-045a-460b-b6e4-3fce34c710b9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:05.717123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 526/1078] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:05.719751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.722551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44698-de8b-4b51-bb1f-efcd41e6e2dc None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.722807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44698-de8b-4b51-bb1f-efcd41e6e2dc None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.723112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44698-de8b-4b51-bb1f-efcd41e6e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.744995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7fc44698-de8b-4b51-bb1f-efcd41e6e2dc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:05.746852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7fc44698-de8b-4b51-bb1f-efcd41e6e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:05.752015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:05.830650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5e96f-045a-460b-b6e4-3fce34c710b9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:05.847557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 527/1079] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:05.868386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0833a40-9ef1-4a27-b12c-3ec11cb82686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:05.868999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0833a40-9ef1-4a27-b12c-3ec11cb82686 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:05.869281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0833a40-9ef1-4a27-b12c-3ec11cb82686 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:05.869557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0833a40-9ef1-4a27-b12c-3ec11cb82686 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:05.870256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0833a40-9ef1-4a27-b12c-3ec11cb82686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:05.870566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0833a40-9ef1-4a27-b12c-3ec11cb82686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:05.872021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0833a40-9ef1-4a27-b12c-3ec11cb82686 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:05.890622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 553/1080] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:05.896243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44698-de8b-4b51-bb1f-efcd41e6e2dc None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.012187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44698-de8b-4b51-bb1f-efcd41e6e2dc None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.048669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0383a-b7c0-478a-b6a3-e59f9c97fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.049330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0383a-b7c0-478a-b6a3-e59f9c97fa8b None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.049613 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0383a-b7c0-478a-b6a3-e59f9c97fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.049889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0383a-b7c0-478a-b6a3-e59f9c97fa8b None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/5cbda75c38b04e6c89f17e655eb4f737/roles/d054d237c41c4a96b795919b8532cda1` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.052484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0383a-b7c0-478a-b6a3-e59f9c97fa8b None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=5cbda75c38b04e6c89f17e655eb4f737, role_id=d054d237c41c4a96b795919b8532cda1)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.053919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0383a-b7c0-478a-b6a3-e59f9c97fa8b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.063316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:06.075038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 528/1081] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:05 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/5cbda75c38b04e6c89f17e655eb4f737/roles/d054d237c41c4a96b795919b8532cda1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:28:06.132070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0833a40-9ef1-4a27-b12c-3ec11cb82686 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.205447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:06.248559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0833a40-9ef1-4a27-b12c-3ec11cb82686 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.284778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a858ed4-e699-40e8-bedc-acd32617c73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.285394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a858ed4-e699-40e8-bedc-acd32617c73e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.285677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a858ed4-e699-40e8-bedc-acd32617c73e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.285953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a858ed4-e699-40e8-bedc-acd32617c73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.353670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a858ed4-e699-40e8-bedc-acd32617c73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.355154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a858ed4-e699-40e8-bedc-acd32617c73e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.415964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:06.459029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 554/1082] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:06.462248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0383a-b7c0-478a-b6a3-e59f9c97fa8b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.566365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0383a-b7c0-478a-b6a3-e59f9c97fa8b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.600896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25dee2-6169-4a74-8e9f-5da746635d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.601547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25dee2-6169-4a74-8e9f-5da746635d49 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.601812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25dee2-6169-4a74-8e9f-5da746635d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.602087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25dee2-6169-4a74-8e9f-5da746635d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.614001 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25dee2-6169-4a74-8e9f-5da746635d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.615888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25dee2-6169-4a74-8e9f-5da746635d49 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-7f25dee2-6169-4a74-8e9f-5da746635d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:06.631299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:06.632269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:06.638022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:06.638022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:06.638022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:06.638022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 529/1083] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:06.638630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a858ed4-e699-40e8-bedc-acd32617c73e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:06.736356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a858ed4-e699-40e8-bedc-acd32617c73e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:06.770228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310812ad-1a43-4025-8922-58672ef0cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:06.770834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310812ad-1a43-4025-8922-58672ef0cd95 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:06.771142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310812ad-1a43-4025-8922-58672ef0cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:06.771419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310812ad-1a43-4025-8922-58672ef0cd95 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:06.772059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310812ad-1a43-4025-8922-58672ef0cd95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:06.772363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310812ad-1a43-4025-8922-58672ef0cd95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:06.773718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310812ad-1a43-4025-8922-58672ef0cd95 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:06.794980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 555/1084] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:07.441912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0f109-e58e-41ac-93bc-abe59b8837c8 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:07.442441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0f109-e58e-41ac-93bc-abe59b8837c8 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:07.442441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0f109-e58e-41ac-93bc-abe59b8837c8 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:07.443838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 530/1085] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:07.449091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3dc8-b967-4a4d-b21c-14185a7f75ec None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:07.449376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3dc8-b967-4a4d-b21c-14185a7f75ec None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:07.449652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff3dc8-b967-4a4d-b21c-14185a7f75ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:07.467173 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-16ff3dc8-b967-4a4d-b21c-14185a7f75ec None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:07.468821 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-16ff3dc8-b967-4a4d-b21c-14185a7f75ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:07.485911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:07.533675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 556/1086] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:07.803585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0f109-e58e-41ac-93bc-abe59b8837c8 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:07.863439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:07.911732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0f109-e58e-41ac-93bc-abe59b8837c8 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:07.946293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace2fe1-846f-4021-9415-b8d543265329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:07.952965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace2fe1-846f-4021-9415-b8d543265329 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:07.953362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace2fe1-846f-4021-9415-b8d543265329 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:07.953734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace2fe1-846f-4021-9415-b8d543265329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:07.964835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace2fe1-846f-4021-9415-b8d543265329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-bace2fe1-846f-4021-9415-b8d543265329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:07.970105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:07.971238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:07.972107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 531/1087] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:07.977346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff3dc8-b967-4a4d-b21c-14185a7f75ec None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:08.010350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1018-b2d5-4b0d-a471-d05b20f667c3 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.010637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1018-b2d5-4b0d-a471-d05b20f667c3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.010911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb1018-b2d5-4b0d-a471-d05b20f667c3 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.012279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 532/1088] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:28:08.018079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9d44-bc0e-4d3c-85dd-abf214db01ef None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.018367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9d44-bc0e-4d3c-85dd-abf214db01ef None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.018640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be9d44-bc0e-4d3c-85dd-abf214db01ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.037685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-14be9d44-bc0e-4d3c-85dd-abf214db01ef None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:08.038947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-14be9d44-bc0e-4d3c-85dd-abf214db01ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:08.091830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff3dc8-b967-4a4d-b21c-14185a7f75ec None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:08.113229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 533/1089] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:08.130353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6edc00-4a75-4d61-a1d9-c53d58dbfa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:08.130995 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6edc00-4a75-4d61-a1d9-c53d58dbfa9f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.131266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6edc00-4a75-4d61-a1d9-c53d58dbfa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.131547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6edc00-4a75-4d61-a1d9-c53d58dbfa9f None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.132231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6edc00-4a75-4d61-a1d9-c53d58dbfa9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:08.132571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6edc00-4a75-4d61-a1d9-c53d58dbfa9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:08.133941 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6edc00-4a75-4d61-a1d9-c53d58dbfa9f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:08.143072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 557/1090] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:08.148684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9d44-bc0e-4d3c-85dd-abf214db01ef None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:08.193172 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:08.248185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be9d44-bc0e-4d3c-85dd-abf214db01ef None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:08.281353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851d6e-c2cc-4d9a-a475-48f1e4af712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:08.282032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851d6e-c2cc-4d9a-a475-48f1e4af712b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.282314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851d6e-c2cc-4d9a-a475-48f1e4af712b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.282582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52851d6e-c2cc-4d9a-a475-48f1e4af712b None admin] PATH_INFO: `/v3/users/b0680d9f4fe64a3a9d06f71001cab929` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.283740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52851d6e-c2cc-4d9a-a475-48f1e4af712b None admin] RBAC: Authorizing `identity:get_user(user_id=b0680d9f4fe64a3a9d06f71001cab929)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:08.285150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52851d6e-c2cc-4d9a-a475-48f1e4af712b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:08.286717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 534/1091] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:08 2022] GET /identity/v3/users/b0680d9f4fe64a3a9d06f71001cab929 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:08.292657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6edc00-4a75-4d61-a1d9-c53d58dbfa9f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:08.311601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:08.380473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851d6e-c2cc-4d9a-a475-48f1e4af712b None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:08.393768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6edc00-4a75-4d61-a1d9-c53d58dbfa9f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:08.427427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7c945-36e1-4af8-8a35-130c1605cdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:08.428033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7c945-36e1-4af8-8a35-130c1605cdc2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.428309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7c945-36e1-4af8-8a35-130c1605cdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.428581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7c945-36e1-4af8-8a35-130c1605cdc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.487492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52851d6e-c2cc-4d9a-a475-48f1e4af712b None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:08.496861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7c945-36e1-4af8-8a35-130c1605cdc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:08.497654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:08.498293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7c945-36e1-4af8-8a35-130c1605cdc2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:08.516129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:08.523215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e2dbe-5b5b-4f99-94f6-aea2310fd638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:08.523852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e2dbe-5b5b-4f99-94f6-aea2310fd638 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.524142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e2dbe-5b5b-4f99-94f6-aea2310fd638 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.524423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e2dbe-5b5b-4f99-94f6-aea2310fd638 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.535914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e2dbe-5b5b-4f99-94f6-aea2310fd638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-993e2dbe-5b5b-4f99-94f6-aea2310fd638 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:08.540652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:08.541738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:08.542560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 535/1092] 10.222.0.89 () {56 vars in 1120 bytes} [Fri Aug 26 15:28:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:08.548151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e2dbe-5b5b-4f99-94f6-aea2310fd638 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:08.599695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 558/1093] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:08.605590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7c945-36e1-4af8-8a35-130c1605cdc2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:08.645713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e2dbe-5b5b-4f99-94f6-aea2310fd638 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:08.678535 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9146342-eee1-4478-886f-825411b3ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:08.679161 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9146342-eee1-4478-886f-825411b3ec23 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.679446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9146342-eee1-4478-886f-825411b3ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.679721 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9146342-eee1-4478-886f-825411b3ec23 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.680462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9146342-eee1-4478-886f-825411b3ec23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:08.680769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9146342-eee1-4478-886f-825411b3ec23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:08.682137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9146342-eee1-4478-886f-825411b3ec23 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:08.690925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 536/1094] 10.222.0.89 () {56 vars in 1115 bytes} [Fri Aug 26 15:28:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:08.697263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9146342-eee1-4478-886f-825411b3ec23 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:08.702761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7c945-36e1-4af8-8a35-130c1605cdc2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:08.719017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:08.738216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7c72-6a79-4ca1-8f75-2d5a8a616527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:08.738843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7c72-6a79-4ca1-8f75-2d5a8a616527 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.739156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7c72-6a79-4ca1-8f75-2d5a8a616527 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.739424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7c72-6a79-4ca1-8f75-2d5a8a616527 None admin] PATH_INFO: `/v3/projects/3960f599dbb54231b4645651556c0fc7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.740522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f7c72-6a79-4ca1-8f75-2d5a8a616527 None admin] RBAC: Authorizing `identity:get_project(project_id=3960f599dbb54231b4645651556c0fc7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:08.741960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f7c72-6a79-4ca1-8f75-2d5a8a616527 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:08.743630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 559/1095] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:08 2022] GET /identity/v3/projects/3960f599dbb54231b4645651556c0fc7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:08.748706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:08.750889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7c72-6a79-4ca1-8f75-2d5a8a616527 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:08.823043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9146342-eee1-4478-886f-825411b3ec23 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:08.851231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7c72-6a79-4ca1-8f75-2d5a8a616527 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:08.859592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a89842-fc28-4cc8-b344-31ba29906fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:08.860235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a89842-fc28-4cc8-b344-31ba29906fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.860513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a89842-fc28-4cc8-b344-31ba29906fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.860783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a89842-fc28-4cc8-b344-31ba29906fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.873421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a89842-fc28-4cc8-b344-31ba29906fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:08.875239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a89842-fc28-4cc8-b344-31ba29906fc1 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:08.886454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461afbf-5433-4024-94c4-6418194f1d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:08.887103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461afbf-5433-4024-94c4-6418194f1d6b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:08.887380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461afbf-5433-4024-94c4-6418194f1d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:08.887649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461afbf-5433-4024-94c4-6418194f1d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:08.888398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461afbf-5433-4024-94c4-6418194f1d6b None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=3960f599dbb54231b4645651556c0fc7, user.id=b0680d9f4fe64a3a9d06f71001cab929) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:08.888704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461afbf-5433-4024-94c4-6418194f1d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:08.890463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461afbf-5433-4024-94c4-6418194f1d6b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-52a89842-fc28-4cc8-b344-31ba29906fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:08.890971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:08.892776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:08.894461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:08.894461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:08.894461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:08.894461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 537/1096] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:28:08.897609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 560/1097] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:08 2022] GET /identity/v3/role_assignments?user.id=b0680d9f4fe64a3a9d06f71001cab929&scope.project.id=3960f599dbb54231b4645651556c0fc7&role.id=609b1a993a394f0e900e17edccebaea5 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:08.898306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a89842-fc28-4cc8-b344-31ba29906fc1 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:08.990060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.006893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a89842-fc28-4cc8-b344-31ba29906fc1 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.042425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0ea3c-5fe9-4fc3-a41b-cabc2ce3c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.043085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0ea3c-5fe9-4fc3-a41b-cabc2ce3c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.043370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0ea3c-5fe9-4fc3-a41b-cabc2ce3c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.043647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0ea3c-5fe9-4fc3-a41b-cabc2ce3c8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.044307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0ea3c-5fe9-4fc3-a41b-cabc2ce3c8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:09.044619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0ea3c-5fe9-4fc3-a41b-cabc2ce3c8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.046559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0ea3c-5fe9-4fc3-a41b-cabc2ce3c8b8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.058961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 538/1098] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:09.064772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461afbf-5433-4024-94c4-6418194f1d6b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.124276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.177371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461afbf-5433-4024-94c4-6418194f1d6b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.210744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fa648-7986-480f-8b30-bfefababfe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.211407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa648-7986-480f-8b30-bfefababfe40 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.211707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa648-7986-480f-8b30-bfefababfe40 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.211976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa648-7986-480f-8b30-bfefababfe40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.220270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fa648-7986-480f-8b30-bfefababfe40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.221675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fa648-7986-480f-8b30-bfefababfe40 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1c8fa648-7986-480f-8b30-bfefababfe40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:28:09.232595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:09.234132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 15:28:09.235116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:09.235877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 561/1099] 10.222.0.89 () {56 vars in 1093 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:09.240539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0ea3c-5fe9-4fc3-a41b-cabc2ce3c8b8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.345469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0ea3c-5fe9-4fc3-a41b-cabc2ce3c8b8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.378010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b769fc6-3589-42d8-9139-d5fd8a6651bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.378605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b769fc6-3589-42d8-9139-d5fd8a6651bb None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.378882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b769fc6-3589-42d8-9139-d5fd8a6651bb None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.379180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b769fc6-3589-42d8-9139-d5fd8a6651bb None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.379899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b769fc6-3589-42d8-9139-d5fd8a6651bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:09.380207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b769fc6-3589-42d8-9139-d5fd8a6651bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.381623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b769fc6-3589-42d8-9139-d5fd8a6651bb None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.399079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 539/1100] 10.222.0.89 () {56 vars in 1133 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:09.404830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fa648-7986-480f-8b30-bfefababfe40 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.502431 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fa648-7986-480f-8b30-bfefababfe40 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.511031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.535892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b42ec-7321-4d8a-9a06-4edeffde540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.536503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b42ec-7321-4d8a-9a06-4edeffde540a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.536786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b42ec-7321-4d8a-9a06-4edeffde540a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.537064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b42ec-7321-4d8a-9a06-4edeffde540a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.604448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b42ec-7321-4d8a-9a06-4edeffde540a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.605929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b42ec-7321-4d8a-9a06-4edeffde540a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.720126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 562/1101] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 15:28:09.721694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b769fc6-3589-42d8-9139-d5fd8a6651bb None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.724616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.821579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b769fc6-3589-42d8-9139-d5fd8a6651bb None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:09.854035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9d02c-e7cb-47c2-857c-62bd2bb200e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:09.854995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9d02c-e7cb-47c2-857c-62bd2bb200e1 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:09.855281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9d02c-e7cb-47c2-857c-62bd2bb200e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:09.855548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9d02c-e7cb-47c2-857c-62bd2bb200e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:09.866061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9d02c-e7cb-47c2-857c-62bd2bb200e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:09.867531 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9d02c-e7cb-47c2-857c-62bd2bb200e1 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-8cb9d02c-e7cb-47c2-857c-62bd2bb200e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:09.881967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:09.883164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:28:09.884044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:09.884044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:28:09.884044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:09.887086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 540/1102] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:09.888761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b42ec-7321-4d8a-9a06-4edeffde540a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:09.899092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:09.999298 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b42ec-7321-4d8a-9a06-4edeffde540a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.040329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c5e6b-7a37-4b56-b8b7-06eb5cc52674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.041035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c5e6b-7a37-4b56-b8b7-06eb5cc52674 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.041327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c5e6b-7a37-4b56-b8b7-06eb5cc52674 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.041604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c5e6b-7a37-4b56-b8b7-06eb5cc52674 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.042387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c5e6b-7a37-4b56-b8b7-06eb5cc52674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:10.042798 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c5e6b-7a37-4b56-b8b7-06eb5cc52674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.044545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c5e6b-7a37-4b56-b8b7-06eb5cc52674 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.057771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 563/1103] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:10.063539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9d02c-e7cb-47c2-857c-62bd2bb200e1 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.124542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.173022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9d02c-e7cb-47c2-857c-62bd2bb200e1 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.209651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f05fa1-8aa6-4174-be95-f9c3a332c244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.210284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f05fa1-8aa6-4174-be95-f9c3a332c244 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.210563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f05fa1-8aa6-4174-be95-f9c3a332c244 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.210838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f05fa1-8aa6-4174-be95-f9c3a332c244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.218604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f05fa1-8aa6-4174-be95-f9c3a332c244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.220082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f05fa1-8aa6-4174-be95-f9c3a332c244 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-e0f05fa1-8aa6-4174-be95-f9c3a332c244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:28:10.231049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:10.232112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:10.233006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:28:10.233006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:28:10.233006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:28:10.233006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:28:10.233006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:28:10.233006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:28:10.233006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:28:10.233006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:10.233006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 541/1104] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:10.238000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c5e6b-7a37-4b56-b8b7-06eb5cc52674 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.303329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.336721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c5e6b-7a37-4b56-b8b7-06eb5cc52674 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.368885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1e844-1927-4e1d-a4c3-2629dc747f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.369484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e844-1927-4e1d-a4c3-2629dc747f0b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.369759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e844-1927-4e1d-a4c3-2629dc747f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.370035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e844-1927-4e1d-a4c3-2629dc747f0b None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.370716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1e844-1927-4e1d-a4c3-2629dc747f0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:10.371052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1e844-1927-4e1d-a4c3-2629dc747f0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.372461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1e844-1927-4e1d-a4c3-2629dc747f0b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.384850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 564/1105] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:10.391502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f05fa1-8aa6-4174-be95-f9c3a332c244 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:10.496749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f05fa1-8aa6-4174-be95-f9c3a332c244 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:10.510645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:10.533943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bf9f4-40d6-47cc-8132-1f8f5a0dbc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:10.534659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf9f4-40d6-47cc-8132-1f8f5a0dbc87 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.534971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf9f4-40d6-47cc-8132-1f8f5a0dbc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.535251 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf9f4-40d6-47cc-8132-1f8f5a0dbc87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.536307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bf9f4-40d6-47cc-8132-1f8f5a0dbc87 None admin] RBAC: Adding query filter params (role.id=d054d237c41c4a96b795919b8532cda1, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=5cbda75c38b04e6c89f17e655eb4f737) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:10.536619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bf9f4-40d6-47cc-8132-1f8f5a0dbc87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:10.538076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bf9f4-40d6-47cc-8132-1f8f5a0dbc87 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:10.544974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 542/1106] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:10 2022] GET /identity/v3/role_assignments?user.id=5cbda75c38b04e6c89f17e655eb4f737&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=d054d237c41c4a96b795919b8532cda1 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:10.862471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96963ee9-a3ef-4978-80e1-6d34964154cf None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.863340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96963ee9-a3ef-4978-80e1-6d34964154cf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.863767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96963ee9-a3ef-4978-80e1-6d34964154cf None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.865489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 565/1107] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:10.871466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63c493-a5ff-4fe1-8d0b-bb6efbe30d1f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:10.872165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63c493-a5ff-4fe1-8d0b-bb6efbe30d1f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:10.872165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63c493-a5ff-4fe1-8d0b-bb6efbe30d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:10.891312 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5b63c493-a5ff-4fe1-8d0b-bb6efbe30d1f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:10.892510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5b63c493-a5ff-4fe1-8d0b-bb6efbe30d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:10.962226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 543/1108] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:11.234776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96963ee9-a3ef-4978-80e1-6d34964154cf None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:11.336627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96963ee9-a3ef-4978-80e1-6d34964154cf None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:11.364443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:11.373011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63740c8c-9a1d-423d-b783-d39eb795864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:11.373648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63740c8c-9a1d-423d-b783-d39eb795864e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:11.373953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63740c8c-9a1d-423d-b783-d39eb795864e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:11.374224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63740c8c-9a1d-423d-b783-d39eb795864e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:11.375420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63740c8c-9a1d-423d-b783-d39eb795864e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:11.376849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63740c8c-9a1d-423d-b783-d39eb795864e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:11.378492 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 566/1109] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:11.384317 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63c493-a5ff-4fe1-8d0b-bb6efbe30d1f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:11.482347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63c493-a5ff-4fe1-8d0b-bb6efbe30d1f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:11.492434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:11.520453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367ed66-1b9d-44f4-a3ef-c8b3088e9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:11.521078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367ed66-1b9d-44f4-a3ef-c8b3088e9148 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:11.521362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367ed66-1b9d-44f4-a3ef-c8b3088e9148 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:11.521636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367ed66-1b9d-44f4-a3ef-c8b3088e9148 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:11.522304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367ed66-1b9d-44f4-a3ef-c8b3088e9148 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:11.523763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367ed66-1b9d-44f4-a3ef-c8b3088e9148 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:11.545466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 544/1110] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:28:11 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:28:13.588806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3fa88-0684-45f9-b23b-d4562fecb2af None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:13.589335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3fa88-0684-45f9-b23b-d4562fecb2af None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:13.589335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3fa88-0684-45f9-b23b-d4562fecb2af None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:13.590674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 567/1111] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:13.596001 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6c1b-48d8-42ce-ae1b-75af48242eeb None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:13.596376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6c1b-48d8-42ce-ae1b-75af48242eeb None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:13.596552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6c1b-48d8-42ce-ae1b-75af48242eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:13.615009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c99c6c1b-48d8-42ce-ae1b-75af48242eeb None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:13.616201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c99c6c1b-48d8-42ce-ae1b-75af48242eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:13.689030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 545/1112] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:13.955777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3fa88-0684-45f9-b23b-d4562fecb2af None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:14.068047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3fa88-0684-45f9-b23b-d4562fecb2af None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:14.103607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844727e9-1225-4b8f-91f3-35614dc19947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:14.104244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844727e9-1225-4b8f-91f3-35614dc19947 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:14.104529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844727e9-1225-4b8f-91f3-35614dc19947 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:14.104805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844727e9-1225-4b8f-91f3-35614dc19947 None admin] PATH_INFO: `/v3/roles/88da3cfff1d74296962f08ef7829479c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:14.106344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844727e9-1225-4b8f-91f3-35614dc19947 None admin] RBAC: Authorizing `identity:get_role(role_id=88da3cfff1d74296962f08ef7829479c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:14.107705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844727e9-1225-4b8f-91f3-35614dc19947 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:14.109918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 568/1113] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:13 2022] GET /identity/v3/roles/88da3cfff1d74296962f08ef7829479c => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:14.115692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c6c1b-48d8-42ce-ae1b-75af48242eeb None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:14.205765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:14.213195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c6c1b-48d8-42ce-ae1b-75af48242eeb None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:14.247358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ebbc-1729-4792-b15e-fc0e4b37829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:14.247985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ebbc-1729-4792-b15e-fc0e4b37829f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:14.248268 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ebbc-1729-4792-b15e-fc0e4b37829f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:14.248546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ebbc-1729-4792-b15e-fc0e4b37829f None admin] PATH_INFO: `/v3/users/d6ce62795ba441938018ccccf9f84a99` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:14.261336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125ebbc-1729-4792-b15e-fc0e4b37829f None admin] RBAC: Authorizing `identity:get_user(user_id=d6ce62795ba441938018ccccf9f84a99)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:14.262777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125ebbc-1729-4792-b15e-fc0e4b37829f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:14.264647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 546/1114] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:14 2022] GET /identity/v3/users/d6ce62795ba441938018ccccf9f84a99 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:14.270507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844727e9-1225-4b8f-91f3-35614dc19947 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:14.335581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:14.377659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844727e9-1225-4b8f-91f3-35614dc19947 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:14.411662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be068dd8-b9c2-4903-a0dc-4ed723bb1893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:14.412265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be068dd8-b9c2-4903-a0dc-4ed723bb1893 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:14.412542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be068dd8-b9c2-4903-a0dc-4ed723bb1893 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:14.412814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be068dd8-b9c2-4903-a0dc-4ed723bb1893 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:14.478401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be068dd8-b9c2-4903-a0dc-4ed723bb1893 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:14.479777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be068dd8-b9c2-4903-a0dc-4ed723bb1893 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:14.538088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:14.575027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 569/1115] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:14.581441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ebbc-1729-4792-b15e-fc0e4b37829f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:14.676297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ebbc-1729-4792-b15e-fc0e4b37829f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:14.709182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a661bb-9134-4788-849d-0c942e1f2c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:14.709809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a661bb-9134-4788-849d-0c942e1f2c7e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:14.710098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a661bb-9134-4788-849d-0c942e1f2c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:14.710374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a661bb-9134-4788-849d-0c942e1f2c7e None admin] PATH_INFO: `/v3/projects/3960f599dbb54231b4645651556c0fc7` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:14.711510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a661bb-9134-4788-849d-0c942e1f2c7e None admin] RBAC: Authorizing `identity:get_project(project_id=3960f599dbb54231b4645651556c0fc7)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:14.712948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a661bb-9134-4788-849d-0c942e1f2c7e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:14.714570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 547/1116] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:14 2022] GET /identity/v3/projects/3960f599dbb54231b4645651556c0fc7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:14.721244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be068dd8-b9c2-4903-a0dc-4ed723bb1893 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:14.818204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be068dd8-b9c2-4903-a0dc-4ed723bb1893 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:14.851870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d166f0-4678-47e0-abcd-7547b6b905f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:14.852476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d166f0-4678-47e0-abcd-7547b6b905f6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:14.852755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d166f0-4678-47e0-abcd-7547b6b905f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:14.853026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d166f0-4678-47e0-abcd-7547b6b905f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:14.853758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d166f0-4678-47e0-abcd-7547b6b905f6 None admin] RBAC: Adding query filter params (role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=3960f599dbb54231b4645651556c0fc7, user.id=d6ce62795ba441938018ccccf9f84a99) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:14.854064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d166f0-4678-47e0-abcd-7547b6b905f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:14.855527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d166f0-4678-47e0-abcd-7547b6b905f6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:14.861487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 570/1117] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:14 2022] GET /identity/v3/role_assignments?user.id=d6ce62795ba441938018ccccf9f84a99&scope.project.id=3960f599dbb54231b4645651556c0fc7&role.id=88da3cfff1d74296962f08ef7829479c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:16.742858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92134383-f78d-4064-8068-9d36aed39ba4 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:16.743609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92134383-f78d-4064-8068-9d36aed39ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:16.743609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92134383-f78d-4064-8068-9d36aed39ba4 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:16.744775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 548/1118] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:28:16.750495 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54e78-1780-49ca-9cdb-6291905d2c03 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:16.750944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54e78-1780-49ca-9cdb-6291905d2c03 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:16.751084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54e78-1780-49ca-9cdb-6291905d2c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:16.768943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-dab54e78-1780-49ca-9cdb-6291905d2c03 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:16.770133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dab54e78-1780-49ca-9cdb-6291905d2c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:16.792337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:16.836843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 571/1119] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:17.104648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92134383-f78d-4064-8068-9d36aed39ba4 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:17.126263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:17.202527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92134383-f78d-4064-8068-9d36aed39ba4 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:17.234841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a16889-b8c4-4870-8869-c4a4ec9be027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:17.235480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a16889-b8c4-4870-8869-c4a4ec9be027 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:17.235758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a16889-b8c4-4870-8869-c4a4ec9be027 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:17.236028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a16889-b8c4-4870-8869-c4a4ec9be027 None admin] PATH_INFO: `/v3/roles/88da3cfff1d74296962f08ef7829479c` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:17.237391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a16889-b8c4-4870-8869-c4a4ec9be027 None admin] RBAC: Authorizing `identity:get_role(role_id=88da3cfff1d74296962f08ef7829479c)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:17.238738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a16889-b8c4-4870-8869-c4a4ec9be027 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:17.240056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 549/1120] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:17 2022] GET /identity/v3/roles/88da3cfff1d74296962f08ef7829479c => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:17.245868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab54e78-1780-49ca-9cdb-6291905d2c03 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:17.347213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab54e78-1780-49ca-9cdb-6291905d2c03 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:17.381169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2885e-d706-4ad9-aac2-2f77cf8f4de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:17.381722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2885e-d706-4ad9-aac2-2f77cf8f4de9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:17.382002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2885e-d706-4ad9-aac2-2f77cf8f4de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:17.382277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2885e-d706-4ad9-aac2-2f77cf8f4de9 None admin] PATH_INFO: `/v3/users/d6ce62795ba441938018ccccf9f84a99` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:17.383425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2885e-d706-4ad9-aac2-2f77cf8f4de9 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ce62795ba441938018ccccf9f84a99)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:17.384853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2885e-d706-4ad9-aac2-2f77cf8f4de9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:17.386446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 572/1121] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:17 2022] GET /identity/v3/users/d6ce62795ba441938018ccccf9f84a99 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:17.393182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a16889-b8c4-4870-8869-c4a4ec9be027 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:17.480947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:17.493504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a16889-b8c4-4870-8869-c4a4ec9be027 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:17.526051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b2170-0099-4ef4-9b36-eaf374c97648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:17.526666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2170-0099-4ef4-9b36-eaf374c97648 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:17.526964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2170-0099-4ef4-9b36-eaf374c97648 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:17.527246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b2170-0099-4ef4-9b36-eaf374c97648 None admin] PATH_INFO: `/v3/projects/3960f599dbb54231b4645651556c0fc7` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:17.528338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b2170-0099-4ef4-9b36-eaf374c97648 None admin] RBAC: Authorizing `identity:get_project(project_id=3960f599dbb54231b4645651556c0fc7)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:17.529748 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b2170-0099-4ef4-9b36-eaf374c97648 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:17.531429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 550/1122] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:17 2022] GET /identity/v3/projects/3960f599dbb54231b4645651556c0fc7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:17.537703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2885e-d706-4ad9-aac2-2f77cf8f4de9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:17.568276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:17.638118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2885e-d706-4ad9-aac2-2f77cf8f4de9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:17.672635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267530-68cd-4550-b11a-65785fa4cb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:17.673290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267530-68cd-4550-b11a-65785fa4cb0c None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:17.673569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267530-68cd-4550-b11a-65785fa4cb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:17.673844 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267530-68cd-4550-b11a-65785fa4cb0c None admin] PATH_INFO: `/v3/projects/3960f599dbb54231b4645651556c0fc7/users/d6ce62795ba441938018ccccf9f84a99/roles/88da3cfff1d74296962f08ef7829479c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:17.676010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267530-68cd-4550-b11a-65785fa4cb0c None admin] RBAC: Authorizing `identity:create_grant(project_id=3960f599dbb54231b4645651556c0fc7, user_id=d6ce62795ba441938018ccccf9f84a99, role_id=88da3cfff1d74296962f08ef7829479c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:17.677432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267530-68cd-4550-b11a-65785fa4cb0c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:17.689841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 573/1123] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:17 2022] PUT /identity/v3/projects/3960f599dbb54231b4645651556c0fc7/users/d6ce62795ba441938018ccccf9f84a99/roles/88da3cfff1d74296962f08ef7829479c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:28:19.590009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35c86-a096-4414-87af-1cf020d6a7d9 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:19.590537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35c86-a096-4414-87af-1cf020d6a7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:19.590651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35c86-a096-4414-87af-1cf020d6a7d9 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:19.591923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 551/1124] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:19.597149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987091-dfd4-4ef1-a7e9-b7b91e267a7c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:19.597601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987091-dfd4-4ef1-a7e9-b7b91e267a7c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:19.597700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987091-dfd4-4ef1-a7e9-b7b91e267a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:19.615392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-45987091-dfd4-4ef1-a7e9-b7b91e267a7c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:19.616578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-45987091-dfd4-4ef1-a7e9-b7b91e267a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:19.684115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 574/1125] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:19.950142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35c86-a096-4414-87af-1cf020d6a7d9 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:20.057421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35c86-a096-4414-87af-1cf020d6a7d9 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:20.091607 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90de92-4568-4576-8122-5e202abd9e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:20.092250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90de92-4568-4576-8122-5e202abd9e13 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:20.092533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90de92-4568-4576-8122-5e202abd9e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:20.092809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90de92-4568-4576-8122-5e202abd9e13 None admin] PATH_INFO: `/v3/roles/88da3cfff1d74296962f08ef7829479c` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:20.094246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90de92-4568-4576-8122-5e202abd9e13 None admin] RBAC: Authorizing `identity:get_role(role_id=88da3cfff1d74296962f08ef7829479c)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:20.095647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90de92-4568-4576-8122-5e202abd9e13 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:20.096989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 552/1126] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:19 2022] GET /identity/v3/roles/88da3cfff1d74296962f08ef7829479c => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:20.103280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987091-dfd4-4ef1-a7e9-b7b91e267a7c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:20.125239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:20.204891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987091-dfd4-4ef1-a7e9-b7b91e267a7c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:20.237962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6885e51-e9be-4645-b9b0-b72cc2931699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:20.238586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6885e51-e9be-4645-b9b0-b72cc2931699 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:20.238870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6885e51-e9be-4645-b9b0-b72cc2931699 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:20.239174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6885e51-e9be-4645-b9b0-b72cc2931699 None admin] PATH_INFO: `/v3/users/d6ce62795ba441938018ccccf9f84a99` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:20.240292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6885e51-e9be-4645-b9b0-b72cc2931699 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ce62795ba441938018ccccf9f84a99)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:20.241715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6885e51-e9be-4645-b9b0-b72cc2931699 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:20.243320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 575/1127] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:20 2022] GET /identity/v3/users/d6ce62795ba441938018ccccf9f84a99 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:20.249121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90de92-4568-4576-8122-5e202abd9e13 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:20.273746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:20.349908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90de92-4568-4576-8122-5e202abd9e13 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:20.384559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06d1a8-411b-4d8c-9118-317919d34163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:20.385168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06d1a8-411b-4d8c-9118-317919d34163 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:20.385451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06d1a8-411b-4d8c-9118-317919d34163 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:20.385726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06d1a8-411b-4d8c-9118-317919d34163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:20.456342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06d1a8-411b-4d8c-9118-317919d34163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:20.457705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06d1a8-411b-4d8c-9118-317919d34163 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:20.481690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:20.556694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 553/1128] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:20.562654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6885e51-e9be-4645-b9b0-b72cc2931699 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:20.642354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:20.658379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6885e51-e9be-4645-b9b0-b72cc2931699 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:20.690435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9ad14-7dc5-43a2-80a9-a8d3fc5cb482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:20.691086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ad14-7dc5-43a2-80a9-a8d3fc5cb482 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:20.691362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ad14-7dc5-43a2-80a9-a8d3fc5cb482 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:20.691630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9ad14-7dc5-43a2-80a9-a8d3fc5cb482 None admin] PATH_INFO: `/v3/projects/3960f599dbb54231b4645651556c0fc7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:20.692721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9ad14-7dc5-43a2-80a9-a8d3fc5cb482 None admin] RBAC: Authorizing `identity:get_project(project_id=3960f599dbb54231b4645651556c0fc7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:20.694136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9ad14-7dc5-43a2-80a9-a8d3fc5cb482 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:20.695780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 576/1129] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:20 2022] GET /identity/v3/projects/3960f599dbb54231b4645651556c0fc7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:20.702422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06d1a8-411b-4d8c-9118-317919d34163 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:20.803138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06d1a8-411b-4d8c-9118-317919d34163 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:20.826618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:20.837856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914da20-bd03-4114-a9dc-711364d240dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:20.838458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914da20-bd03-4114-a9dc-711364d240dd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:20.838736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914da20-bd03-4114-a9dc-711364d240dd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:20.839038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914da20-bd03-4114-a9dc-711364d240dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:20.839757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914da20-bd03-4114-a9dc-711364d240dd None admin] RBAC: Adding query filter params (role.id=88da3cfff1d74296962f08ef7829479c, scope.project.id=3960f599dbb54231b4645651556c0fc7, user.id=d6ce62795ba441938018ccccf9f84a99) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:20.840062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914da20-bd03-4114-a9dc-711364d240dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:20.841488 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914da20-bd03-4114-a9dc-711364d240dd None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:20.847675 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 554/1130] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:20 2022] GET /identity/v3/role_assignments?user.id=d6ce62795ba441938018ccccf9f84a99&scope.project.id=3960f599dbb54231b4645651556c0fc7&role.id=88da3cfff1d74296962f08ef7829479c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:22.774409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c104fa-0f57-4984-bac3-7b6d08b98ca0 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:22.774990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c104fa-0f57-4984-bac3-7b6d08b98ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:22.774990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c104fa-0f57-4984-bac3-7b6d08b98ca0 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:22.776321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 577/1131] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:22.781828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff9e49-f7ba-4a45-b26f-18b82250b4cb None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:22.782296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff9e49-f7ba-4a45-b26f-18b82250b4cb None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:22.782385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff9e49-f7ba-4a45-b26f-18b82250b4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:22.801847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-0fff9e49-f7ba-4a45-b26f-18b82250b4cb None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:22.802840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-0fff9e49-f7ba-4a45-b26f-18b82250b4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:22.869060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 555/1132] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:23.134992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c104fa-0f57-4984-bac3-7b6d08b98ca0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:23.237550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c104fa-0f57-4984-bac3-7b6d08b98ca0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:23.270991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372344ee-5831-4e36-98dd-1364076d9cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:23.271622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372344ee-5831-4e36-98dd-1364076d9cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:23.271902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372344ee-5831-4e36-98dd-1364076d9cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:23.272176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372344ee-5831-4e36-98dd-1364076d9cc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:23.273292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372344ee-5831-4e36-98dd-1364076d9cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:23.274722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372344ee-5831-4e36-98dd-1364076d9cc1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:23.276337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 578/1133] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:23.282833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff9e49-f7ba-4a45-b26f-18b82250b4cb None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:23.379612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff9e49-f7ba-4a45-b26f-18b82250b4cb None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:23.397627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:23.414952 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fdeef3-f35a-4bfc-bac4-7687a3955987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:23.415563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdeef3-f35a-4bfc-bac4-7687a3955987 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:23.415839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdeef3-f35a-4bfc-bac4-7687a3955987 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:23.416111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fdeef3-f35a-4bfc-bac4-7687a3955987 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:23.416756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdeef3-f35a-4bfc-bac4-7687a3955987 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:23.418180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fdeef3-f35a-4bfc-bac4-7687a3955987 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:23.445246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 556/1134] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:28:23 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:28:25.394353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1ffda-96fd-4b0f-a6f1-cca7530549b5 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:25.394918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1ffda-96fd-4b0f-a6f1-cca7530549b5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:25.394918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1ffda-96fd-4b0f-a6f1-cca7530549b5 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:25.396352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 579/1135] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:25.401831 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fddc31-b80c-49d4-83a8-42c5ad9dcc62 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:25.402299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fddc31-b80c-49d4-83a8-42c5ad9dcc62 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:25.402398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fddc31-b80c-49d4-83a8-42c5ad9dcc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:25.420912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-27fddc31-b80c-49d4-83a8-42c5ad9dcc62 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:25.422103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-27fddc31-b80c-49d4-83a8-42c5ad9dcc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:25.488343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 557/1136] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:25.763680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1ffda-96fd-4b0f-a6f1-cca7530549b5 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:25.789097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:25.870493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1ffda-96fd-4b0f-a6f1-cca7530549b5 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:25.910338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0f85a-182d-4766-8b77-99f1c36012e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:25.910989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0f85a-182d-4766-8b77-99f1c36012e6 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:25.911273 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0f85a-182d-4766-8b77-99f1c36012e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:25.911543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0f85a-182d-4766-8b77-99f1c36012e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:25.912651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0f85a-182d-4766-8b77-99f1c36012e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:25.914073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0f85a-182d-4766-8b77-99f1c36012e6 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:25.915671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 580/1137] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:28:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:25.923845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fddc31-b80c-49d4-83a8-42c5ad9dcc62 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:26.017065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:26.020084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fddc31-b80c-49d4-83a8-42c5ad9dcc62 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:26.055116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fb168-b170-439e-82d9-ba21f0718da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:26.055723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fb168-b170-439e-82d9-ba21f0718da5 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:26.056004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fb168-b170-439e-82d9-ba21f0718da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:26.056274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fb168-b170-439e-82d9-ba21f0718da5 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:26.056916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fb168-b170-439e-82d9-ba21f0718da5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:26.058350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fb168-b170-439e-82d9-ba21f0718da5 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:26.080784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 558/1138] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:28:25 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:28:28.028648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2daab-0f01-497e-946b-db59ffa2e4fa None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:28.029200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2daab-0f01-497e-946b-db59ffa2e4fa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:28.029200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2daab-0f01-497e-946b-db59ffa2e4fa None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:28.031102 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 581/1139] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:28.036436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8af10-cb43-463d-8396-9e5cd865f884 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:28.036834 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8af10-cb43-463d-8396-9e5cd865f884 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:28.036978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8af10-cb43-463d-8396-9e5cd865f884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:28.054462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-75b8af10-cb43-463d-8396-9e5cd865f884 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:28.055590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-75b8af10-cb43-463d-8396-9e5cd865f884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:28.128149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 559/1140] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:28.396368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2daab-0f01-497e-946b-db59ffa2e4fa None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:28.487469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:28.500359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2daab-0f01-497e-946b-db59ffa2e4fa None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:28.535898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556e631-b916-4f29-b1e1-e3b73ab7763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:28.536521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556e631-b916-4f29-b1e1-e3b73ab7763c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:28.536795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556e631-b916-4f29-b1e1-e3b73ab7763c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:28.537062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556e631-b916-4f29-b1e1-e3b73ab7763c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:28.547291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556e631-b916-4f29-b1e1-e3b73ab7763c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8556e631-b916-4f29-b1e1-e3b73ab7763c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:28.551935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:28.553086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:28.554352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 582/1141] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:28.559195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8af10-cb43-463d-8396-9e5cd865f884 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:28.639572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:28.655598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8af10-cb43-463d-8396-9e5cd865f884 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:28.688524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf62535-cf21-47d2-b624-5e61ccc6748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:28.689120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf62535-cf21-47d2-b624-5e61ccc6748f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:28.689402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf62535-cf21-47d2-b624-5e61ccc6748f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:28.689676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf62535-cf21-47d2-b624-5e61ccc6748f None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:28.690341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf62535-cf21-47d2-b624-5e61ccc6748f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:28.690647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf62535-cf21-47d2-b624-5e61ccc6748f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:28.692044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf62535-cf21-47d2-b624-5e61ccc6748f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:28.699731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 560/1142] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:28.705528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556e631-b916-4f29-b1e1-e3b73ab7763c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:28.803550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556e631-b916-4f29-b1e1-e3b73ab7763c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:28.835902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15efdc4-c313-4bd1-9a73-d33adb8d5395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:28.836522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15efdc4-c313-4bd1-9a73-d33adb8d5395 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:28.836797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15efdc4-c313-4bd1-9a73-d33adb8d5395 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:28.837067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15efdc4-c313-4bd1-9a73-d33adb8d5395 None admin] PATH_INFO: `/v3/users/8dd926d4dd0d45cdbd411f14e563d0e0` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:28.851261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15efdc4-c313-4bd1-9a73-d33adb8d5395 None admin] RBAC: Authorizing `identity:get_user(user_id=8dd926d4dd0d45cdbd411f14e563d0e0)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:28.853687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15efdc4-c313-4bd1-9a73-d33adb8d5395 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:28.855775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 583/1143] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:28 2022] GET /identity/v3/users/8dd926d4dd0d45cdbd411f14e563d0e0 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:28.863408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf62535-cf21-47d2-b624-5e61ccc6748f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:28.960351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf62535-cf21-47d2-b624-5e61ccc6748f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:28.994116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ceed18-5a9d-4d12-852e-c737be46f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:28.994713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceed18-5a9d-4d12-852e-c737be46f567 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:28.995022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceed18-5a9d-4d12-852e-c737be46f567 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:28.995297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceed18-5a9d-4d12-852e-c737be46f567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:29.012972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:29.061787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ceed18-5a9d-4d12-852e-c737be46f567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:29.063258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ceed18-5a9d-4d12-852e-c737be46f567 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:29.157186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 561/1144] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:29.163097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15efdc4-c313-4bd1-9a73-d33adb8d5395 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:29.171827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:29.258314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15efdc4-c313-4bd1-9a73-d33adb8d5395 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:29.290470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760d775-4e2d-40e7-badb-f2f664cb1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:29.291112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760d775-4e2d-40e7-badb-f2f664cb1bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:29.291388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760d775-4e2d-40e7-badb-f2f664cb1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:29.291657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760d775-4e2d-40e7-badb-f2f664cb1bb2 None admin] PATH_INFO: `/v3/projects/af27237586a34da6b227005445d424da` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:29.292752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760d775-4e2d-40e7-badb-f2f664cb1bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=af27237586a34da6b227005445d424da)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:29.294160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760d775-4e2d-40e7-badb-f2f664cb1bb2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:29.296314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 584/1145] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:29 2022] GET /identity/v3/projects/af27237586a34da6b227005445d424da => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:29.302567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ceed18-5a9d-4d12-852e-c737be46f567 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:29.349781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:29.397957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ceed18-5a9d-4d12-852e-c737be46f567 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:29.430298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915d855-adee-4763-8a9c-4a06088e9a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:29.430888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915d855-adee-4763-8a9c-4a06088e9a50 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:29.431197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915d855-adee-4763-8a9c-4a06088e9a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:29.431469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915d855-adee-4763-8a9c-4a06088e9a50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:29.432189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915d855-adee-4763-8a9c-4a06088e9a50 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=af27237586a34da6b227005445d424da, user.id=8dd926d4dd0d45cdbd411f14e563d0e0) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:29.432497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915d855-adee-4763-8a9c-4a06088e9a50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:29.433910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915d855-adee-4763-8a9c-4a06088e9a50 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:29.439075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 562/1146] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:29 2022] GET /identity/v3/role_assignments?user.id=8dd926d4dd0d45cdbd411f14e563d0e0&scope.project.id=af27237586a34da6b227005445d424da&role.id=609b1a993a394f0e900e17edccebaea5 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:31.313214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f4bbb-36ee-4435-a3db-58c99064fdb1 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:31.313802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f4bbb-36ee-4435-a3db-58c99064fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:31.313802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f4bbb-36ee-4435-a3db-58c99064fdb1 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:31.315176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 585/1147] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:31.320422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207755e-ddf2-4e1b-a435-2059ac34b520 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:31.320817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207755e-ddf2-4e1b-a435-2059ac34b520 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:31.320965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207755e-ddf2-4e1b-a435-2059ac34b520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:31.339395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4207755e-ddf2-4e1b-a435-2059ac34b520 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:31.340585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4207755e-ddf2-4e1b-a435-2059ac34b520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:31.408359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 563/1148] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:31.677875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f4bbb-36ee-4435-a3db-58c99064fdb1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:31.757391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:31.783621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f4bbb-36ee-4435-a3db-58c99064fdb1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:31.820928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e5fc-7e4b-452d-a3d8-bf9bd494e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:31.821561 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e5fc-7e4b-452d-a3d8-bf9bd494e688 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:31.821836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e5fc-7e4b-452d-a3d8-bf9bd494e688 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:31.822104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e5fc-7e4b-452d-a3d8-bf9bd494e688 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:31.832225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19e5fc-7e4b-452d-a3d8-bf9bd494e688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-2d19e5fc-7e4b-452d-a3d8-bf9bd494e688 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:31.836925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:31.838019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:31.839241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 586/1149] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:31.844732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207755e-ddf2-4e1b-a435-2059ac34b520 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:31.887393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:31.945183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207755e-ddf2-4e1b-a435-2059ac34b520 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:31.979951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1606f49-f4fb-4d9b-afed-38a6163c6a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:31.980559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1606f49-f4fb-4d9b-afed-38a6163c6a35 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:31.980836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1606f49-f4fb-4d9b-afed-38a6163c6a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:31.981107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1606f49-f4fb-4d9b-afed-38a6163c6a35 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:31.981770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1606f49-f4fb-4d9b-afed-38a6163c6a35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:31.982071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1606f49-f4fb-4d9b-afed-38a6163c6a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:31.984022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1606f49-f4fb-4d9b-afed-38a6163c6a35 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:31.993211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 564/1150] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:31.999249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e5fc-7e4b-452d-a3d8-bf9bd494e688 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:32.105970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e5fc-7e4b-452d-a3d8-bf9bd494e688 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:32.140630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4af32-9c35-49e9-81ab-8583be606d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:32.141262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4af32-9c35-49e9-81ab-8583be606d44 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:32.141543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4af32-9c35-49e9-81ab-8583be606d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:32.141817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4af32-9c35-49e9-81ab-8583be606d44 None admin] PATH_INFO: `/v3/users/8dd926d4dd0d45cdbd411f14e563d0e0` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:32.143001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4af32-9c35-49e9-81ab-8583be606d44 None admin] RBAC: Authorizing `identity:get_user(user_id=8dd926d4dd0d45cdbd411f14e563d0e0)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:32.144432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4af32-9c35-49e9-81ab-8583be606d44 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:32.146024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 587/1151] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:31 2022] GET /identity/v3/users/8dd926d4dd0d45cdbd411f14e563d0e0 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:32.151920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1606f49-f4fb-4d9b-afed-38a6163c6a35 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:32.253157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1606f49-f4fb-4d9b-afed-38a6163c6a35 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:32.255400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:32.290237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0d1c6-54c9-46ff-89c3-00e2bb2e12c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:32.290870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0d1c6-54c9-46ff-89c3-00e2bb2e12c9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:32.291175 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0d1c6-54c9-46ff-89c3-00e2bb2e12c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:32.291445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0d1c6-54c9-46ff-89c3-00e2bb2e12c9 None admin] PATH_INFO: `/v3/projects/af27237586a34da6b227005445d424da` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:32.292573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0d1c6-54c9-46ff-89c3-00e2bb2e12c9 None admin] RBAC: Authorizing `identity:get_project(project_id=af27237586a34da6b227005445d424da)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:32.293993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0d1c6-54c9-46ff-89c3-00e2bb2e12c9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:32.295675 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 565/1152] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:32 2022] GET /identity/v3/projects/af27237586a34da6b227005445d424da => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:32.302126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4af32-9c35-49e9-81ab-8583be606d44 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:32.305030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:32.403595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4af32-9c35-49e9-81ab-8583be606d44 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:32.437873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151129b-5684-4072-85c7-0c029191cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:32.438521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151129b-5684-4072-85c7-0c029191cf35 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:32.438797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151129b-5684-4072-85c7-0c029191cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:32.439097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151129b-5684-4072-85c7-0c029191cf35 None admin] PATH_INFO: `/v3/projects/af27237586a34da6b227005445d424da/users/8dd926d4dd0d45cdbd411f14e563d0e0/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:32.440974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151129b-5684-4072-85c7-0c029191cf35 None admin] RBAC: Authorizing `identity:create_grant(project_id=af27237586a34da6b227005445d424da, user_id=8dd926d4dd0d45cdbd411f14e563d0e0, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:32.442391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151129b-5684-4072-85c7-0c029191cf35 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:32.457300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 588/1153] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:32 2022] PUT /identity/v3/projects/af27237586a34da6b227005445d424da/users/8dd926d4dd0d45cdbd411f14e563d0e0/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:28:34.357033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585643cd-be65-4e57-aec8-a8641a1674f3 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:34.357758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585643cd-be65-4e57-aec8-a8641a1674f3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:34.357758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585643cd-be65-4e57-aec8-a8641a1674f3 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:34.358982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 566/1154] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:28:34.364451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e1ee-bdb5-45d2-87c5-6ee60044d696 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:34.364944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e1ee-bdb5-45d2-87c5-6ee60044d696 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:34.365041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e1ee-bdb5-45d2-87c5-6ee60044d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:34.384493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6ec1e1ee-bdb5-45d2-87c5-6ee60044d696 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:34.385680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6ec1e1ee-bdb5-45d2-87c5-6ee60044d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:34.441949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:34.454068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 589/1155] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:34.734565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585643cd-be65-4e57-aec8-a8641a1674f3 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:34.841942 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585643cd-be65-4e57-aec8-a8641a1674f3 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:34.880231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbfeaf-c150-4f52-b940-3d8930606819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:34.880864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbfeaf-c150-4f52-b940-3d8930606819 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:34.881147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbfeaf-c150-4f52-b940-3d8930606819 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:34.881423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbfeaf-c150-4f52-b940-3d8930606819 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:34.891838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbfeaf-c150-4f52-b940-3d8930606819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-95dbfeaf-c150-4f52-b940-3d8930606819 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:34.896548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:34.897563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:34.898426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 567/1156] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:34.903762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e1ee-bdb5-45d2-87c5-6ee60044d696 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:35.005852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e1ee-bdb5-45d2-87c5-6ee60044d696 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:35.042404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366880-77bb-48f8-8281-8569db46a548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:35.043036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366880-77bb-48f8-8281-8569db46a548 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:35.043315 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366880-77bb-48f8-8281-8569db46a548 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:35.043586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366880-77bb-48f8-8281-8569db46a548 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:35.044256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366880-77bb-48f8-8281-8569db46a548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:35.044553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366880-77bb-48f8-8281-8569db46a548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:35.046463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366880-77bb-48f8-8281-8569db46a548 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:35.054449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 590/1157] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:35.060352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbfeaf-c150-4f52-b940-3d8930606819 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:35.094749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:35.172447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbfeaf-c150-4f52-b940-3d8930606819 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:35.206196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f191e-9baf-4f72-bf57-2c67b9e7f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:35.206818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f191e-9baf-4f72-bf57-2c67b9e7f185 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:35.207128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f191e-9baf-4f72-bf57-2c67b9e7f185 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:35.207401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f191e-9baf-4f72-bf57-2c67b9e7f185 None admin] PATH_INFO: `/v3/users/8dd926d4dd0d45cdbd411f14e563d0e0` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:35.208509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f191e-9baf-4f72-bf57-2c67b9e7f185 None admin] RBAC: Authorizing `identity:get_user(user_id=8dd926d4dd0d45cdbd411f14e563d0e0)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:35.209936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f191e-9baf-4f72-bf57-2c67b9e7f185 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:35.211536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 568/1158] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:35 2022] GET /identity/v3/users/8dd926d4dd0d45cdbd411f14e563d0e0 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:35.218168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366880-77bb-48f8-8281-8569db46a548 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:35.273571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:35.320183 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366880-77bb-48f8-8281-8569db46a548 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:35.356366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a48f5-b6bc-4e3c-a0ea-80f65e01359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:35.356976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a48f5-b6bc-4e3c-a0ea-80f65e01359d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:35.357257 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a48f5-b6bc-4e3c-a0ea-80f65e01359d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:35.357535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a48f5-b6bc-4e3c-a0ea-80f65e01359d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:35.426047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a48f5-b6bc-4e3c-a0ea-80f65e01359d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:35.427536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a48f5-b6bc-4e3c-a0ea-80f65e01359d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:35.480826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:35.526090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 591/1159] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:35.532458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f191e-9baf-4f72-bf57-2c67b9e7f185 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:35.633289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:35.636357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f191e-9baf-4f72-bf57-2c67b9e7f185 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:35.669670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d71ca-3b79-4dcb-9644-1618c28f8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:35.670292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d71ca-3b79-4dcb-9644-1618c28f8e8e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:35.670571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d71ca-3b79-4dcb-9644-1618c28f8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:35.670838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d71ca-3b79-4dcb-9644-1618c28f8e8e None admin] PATH_INFO: `/v3/projects/af27237586a34da6b227005445d424da` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:35.672185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d71ca-3b79-4dcb-9644-1618c28f8e8e None admin] RBAC: Authorizing `identity:get_project(project_id=af27237586a34da6b227005445d424da)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:35.673606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d71ca-3b79-4dcb-9644-1618c28f8e8e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:35.675248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 569/1160] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:35 2022] GET /identity/v3/projects/af27237586a34da6b227005445d424da => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:35.681609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a48f5-b6bc-4e3c-a0ea-80f65e01359d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:35.777014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a48f5-b6bc-4e3c-a0ea-80f65e01359d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:35.817188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce20a0f-53eb-4e20-8bae-31f2c774dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:35.817794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20a0f-53eb-4e20-8bae-31f2c774dd3a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:35.818067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20a0f-53eb-4e20-8bae-31f2c774dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:35.818333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20a0f-53eb-4e20-8bae-31f2c774dd3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:35.819094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20a0f-53eb-4e20-8bae-31f2c774dd3a None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=af27237586a34da6b227005445d424da, user.id=8dd926d4dd0d45cdbd411f14e563d0e0) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:35.819400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20a0f-53eb-4e20-8bae-31f2c774dd3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:35.820811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20a0f-53eb-4e20-8bae-31f2c774dd3a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:35.826472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 592/1161] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:35 2022] GET /identity/v3/role_assignments?user.id=8dd926d4dd0d45cdbd411f14e563d0e0&scope.project.id=af27237586a34da6b227005445d424da&role.id=609b1a993a394f0e900e17edccebaea5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:28:37.747592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bf109-fc35-4bfc-96ea-d47bfa9e6f8e None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:37.748120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bf109-fc35-4bfc-96ea-d47bfa9e6f8e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:37.748120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bf109-fc35-4bfc-96ea-d47bfa9e6f8e None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:37.750001 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 570/1162] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:37.755160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061117a-d776-447e-92bf-d78e4400f295 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:37.755592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061117a-d776-447e-92bf-d78e4400f295 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:37.755738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061117a-d776-447e-92bf-d78e4400f295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:37.773517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0061117a-d776-447e-92bf-d78e4400f295 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:37.774706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0061117a-d776-447e-92bf-d78e4400f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:37.788351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:37.842054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 593/1163] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:38.114179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bf109-fc35-4bfc-96ea-d47bfa9e6f8e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:38.250056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bf109-fc35-4bfc-96ea-d47bfa9e6f8e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:38.299510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2781bee-15c5-4402-bbb8-c799af2c9ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:38.300515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2781bee-15c5-4402-bbb8-c799af2c9ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:38.300994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2781bee-15c5-4402-bbb8-c799af2c9ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:38.301455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2781bee-15c5-4402-bbb8-c799af2c9ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:38.350894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:38.393136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2781bee-15c5-4402-bbb8-c799af2c9ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:38.394989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2781bee-15c5-4402-bbb8-c799af2c9ba1 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:38.519695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 571/1164] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:38.525583 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061117a-d776-447e-92bf-d78e4400f295 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:38.630769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061117a-d776-447e-92bf-d78e4400f295 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:38.665942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58f18a-c090-4480-a988-75eb575d9b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:38.666497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f18a-c090-4480-a988-75eb575d9b53 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:38.667096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f18a-c090-4480-a988-75eb575d9b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:38.667381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58f18a-c090-4480-a988-75eb575d9b53 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:38.674576 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f18a-c090-4480-a988-75eb575d9b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:38.676054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58f18a-c090-4480-a988-75eb575d9b53 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-ce58f18a-c090-4480-a988-75eb575d9b53 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:38.688111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:38.689342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:38.690578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 594/1165] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:28:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:38.695326 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2781bee-15c5-4402-bbb8-c799af2c9ba1 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:38.762788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:38.809119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2781bee-15c5-4402-bbb8-c799af2c9ba1 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:38.846521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e9ee3-873f-42cb-ae2a-e950f3e559ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:38.847261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e9ee3-873f-42cb-ae2a-e950f3e559ce None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:38.847730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e9ee3-873f-42cb-ae2a-e950f3e559ce None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:38.848373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e9ee3-873f-42cb-ae2a-e950f3e559ce None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:38.849478 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e9ee3-873f-42cb-ae2a-e950f3e559ce None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:38.849857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e9ee3-873f-42cb-ae2a-e950f3e559ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:38.851970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e9ee3-873f-42cb-ae2a-e950f3e559ce None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:38.862985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 572/1166] 10.222.0.89 () {56 vars in 1115 bytes} [Fri Aug 26 15:28:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:40.762030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d065a-df48-4e80-b535-6c8573a77970 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:40.762616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d065a-df48-4e80-b535-6c8573a77970 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:40.762616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d065a-df48-4e80-b535-6c8573a77970 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:40.763960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 595/1167] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:40.770051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853737da-b6d5-4973-a22e-5953819361f2 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:40.770448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853737da-b6d5-4973-a22e-5953819361f2 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:40.770599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853737da-b6d5-4973-a22e-5953819361f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:40.789247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-853737da-b6d5-4973-a22e-5953819361f2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:40.790432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-853737da-b6d5-4973-a22e-5953819361f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:40.855753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 573/1168] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:41.125824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d065a-df48-4e80-b535-6c8573a77970 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:41.137079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:41.230156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d065a-df48-4e80-b535-6c8573a77970 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:41.263783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c2b77-0cfe-4b46-b909-210043ac9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:41.264417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c2b77-0cfe-4b46-b909-210043ac9bb1 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:41.264696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c2b77-0cfe-4b46-b909-210043ac9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:41.264969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c2b77-0cfe-4b46-b909-210043ac9bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:41.265896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c2b77-0cfe-4b46-b909-210043ac9bb1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:41.267289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c2b77-0cfe-4b46-b909-210043ac9bb1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:41.282497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 596/1169] 10.222.0.89 () {60 vars in 1138 bytes} [Fri Aug 26 15:28:41 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:28:43.215266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac4cf-acb7-4b8d-859f-67c32ae84c1d None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:43.215759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac4cf-acb7-4b8d-859f-67c32ae84c1d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:43.215759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac4cf-acb7-4b8d-859f-67c32ae84c1d None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:43.217005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 574/1170] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:43.222884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d7711-3660-4bdc-915f-d9a10fec299b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:43.223292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d7711-3660-4bdc-915f-d9a10fec299b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:43.223454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d7711-3660-4bdc-915f-d9a10fec299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:43.244025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-486d7711-3660-4bdc-915f-d9a10fec299b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:43.245210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-486d7711-3660-4bdc-915f-d9a10fec299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:43.306218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:43.313033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 597/1171] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:43.584641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ac4cf-acb7-4b8d-859f-67c32ae84c1d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:43.647548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:43.686868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ac4cf-acb7-4b8d-859f-67c32ae84c1d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:43.721800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202da29-72c6-4a6a-b964-b80ab60a636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:43.722427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202da29-72c6-4a6a-b964-b80ab60a636b None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:43.722707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202da29-72c6-4a6a-b964-b80ab60a636b None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:43.723003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202da29-72c6-4a6a-b964-b80ab60a636b None admin] PATH_INFO: `/v3/domains/63e684cf5af143248f30a05379b98792` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:43.734079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202da29-72c6-4a6a-b964-b80ab60a636b None admin] RBAC: Authorizing `identity:get_domain(domain_id=63e684cf5af143248f30a05379b98792)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:43.735556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202da29-72c6-4a6a-b964-b80ab60a636b None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:43.737193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 575/1172] 10.222.0.89 () {56 vars in 1183 bytes} [Fri Aug 26 15:28:43 2022] GET /identity/v3/domains/63e684cf5af143248f30a05379b98792 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:43.743222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d7711-3660-4bdc-915f-d9a10fec299b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:43.846432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d7711-3660-4bdc-915f-d9a10fec299b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:43.880885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a978db1-0a22-481f-b14e-58c21d7a2c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:43.881489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a978db1-0a22-481f-b14e-58c21d7a2c89 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:43.881767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a978db1-0a22-481f-b14e-58c21d7a2c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:43.882042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a978db1-0a22-481f-b14e-58c21d7a2c89 None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:43.882701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a978db1-0a22-481f-b14e-58c21d7a2c89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:43.884152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a978db1-0a22-481f-b14e-58c21d7a2c89 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:43.913289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 598/1173] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:28:43 2022] POST /identity/v3/projects => generated 361 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:28:45.832328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997e3b9-840a-4409-9bc1-ba75fad0bbd3 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:45.832870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997e3b9-840a-4409-9bc1-ba75fad0bbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:45.832870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997e3b9-840a-4409-9bc1-ba75fad0bbd3 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:45.834206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 576/1174] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:45.839656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20748-3b51-42ef-a644-0c51b41dc0bf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:45.840071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20748-3b51-42ef-a644-0c51b41dc0bf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:45.840213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20748-3b51-42ef-a644-0c51b41dc0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:45.858803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7cd20748-3b51-42ef-a644-0c51b41dc0bf None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:45.860033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7cd20748-3b51-42ef-a644-0c51b41dc0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:45.905761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:45.926904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 599/1175] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:46.197555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997e3b9-840a-4409-9bc1-ba75fad0bbd3 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:46.295414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997e3b9-840a-4409-9bc1-ba75fad0bbd3 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:46.317145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:46.328768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf9b63-f2ba-44ea-b2fc-5b7fea68ee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:46.329381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9b63-f2ba-44ea-b2fc-5b7fea68ee15 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:46.329658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9b63-f2ba-44ea-b2fc-5b7fea68ee15 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:46.329929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9b63-f2ba-44ea-b2fc-5b7fea68ee15 None admin] PATH_INFO: `/v3/domains/63e684cf5af143248f30a05379b98792` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:46.331043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf9b63-f2ba-44ea-b2fc-5b7fea68ee15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=63e684cf5af143248f30a05379b98792)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:46.332462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf9b63-f2ba-44ea-b2fc-5b7fea68ee15 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:46.333994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 577/1176] 10.222.0.89 () {56 vars in 1183 bytes} [Fri Aug 26 15:28:46 2022] GET /identity/v3/domains/63e684cf5af143248f30a05379b98792 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:46.339778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20748-3b51-42ef-a644-0c51b41dc0bf None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:46.433709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20748-3b51-42ef-a644-0c51b41dc0bf None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:46.466863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34363a-78c7-4a86-a6b8-dd6338936e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:46.467521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34363a-78c7-4a86-a6b8-dd6338936e64 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:46.467800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34363a-78c7-4a86-a6b8-dd6338936e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:46.468073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34363a-78c7-4a86-a6b8-dd6338936e64 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:46.468725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34363a-78c7-4a86-a6b8-dd6338936e64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:46.470138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34363a-78c7-4a86-a6b8-dd6338936e64 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:46.490469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 600/1177] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:28:46 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:28:48.441966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e2196-e668-4716-b42b-5960dc148767 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:48.442581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e2196-e668-4716-b42b-5960dc148767 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:48.442581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e2196-e668-4716-b42b-5960dc148767 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:48.443954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 578/1178] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:48.449174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391ff1-8d92-4b4a-9b7e-25b45ac535fc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:48.449608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391ff1-8d92-4b4a-9b7e-25b45ac535fc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:48.449758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80391ff1-8d92-4b4a-9b7e-25b45ac535fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:48.467928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-80391ff1-8d92-4b4a-9b7e-25b45ac535fc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:48.469096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-80391ff1-8d92-4b4a-9b7e-25b45ac535fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:48.496297 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:48.535236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 601/1179] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:28:48.807388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e2196-e668-4716-b42b-5960dc148767 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:48.905562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e2196-e668-4716-b42b-5960dc148767 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:48.938645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62737e4d-b4ce-4016-918c-c41768734092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:48.939730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737e4d-b4ce-4016-918c-c41768734092 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:48.940246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737e4d-b4ce-4016-918c-c41768734092 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:48.940761 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62737e4d-b4ce-4016-918c-c41768734092 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:48.950669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62737e4d-b4ce-4016-918c-c41768734092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-62737e4d-b4ce-4016-918c-c41768734092 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:48.962193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:48.963506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:48.964599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 579/1180] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:48.965461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80391ff1-8d92-4b4a-9b7e-25b45ac535fc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:49.059197 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80391ff1-8d92-4b4a-9b7e-25b45ac535fc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:49.092318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccade226-d32b-44ad-bac9-702f5a61b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:49.092924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccade226-d32b-44ad-bac9-702f5a61b16e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:49.093205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccade226-d32b-44ad-bac9-702f5a61b16e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:49.093480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccade226-d32b-44ad-bac9-702f5a61b16e None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:49.094143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccade226-d32b-44ad-bac9-702f5a61b16e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:49.094447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccade226-d32b-44ad-bac9-702f5a61b16e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:49.095848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccade226-d32b-44ad-bac9-702f5a61b16e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:49.103611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 602/1181] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:49.109721 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62737e4d-b4ce-4016-918c-c41768734092 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:49.160235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:49.208791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62737e4d-b4ce-4016-918c-c41768734092 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:49.240705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067659-71ea-4637-a7ae-baabe29568f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:49.241318 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067659-71ea-4637-a7ae-baabe29568f8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:49.241596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067659-71ea-4637-a7ae-baabe29568f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:49.241869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067659-71ea-4637-a7ae-baabe29568f8 None admin] PATH_INFO: `/v3/users/951f7d842ed043389ab01a2466ddefc0` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:49.254954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0067659-71ea-4637-a7ae-baabe29568f8 None admin] RBAC: Authorizing `identity:get_user(user_id=951f7d842ed043389ab01a2466ddefc0)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:49.256395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0067659-71ea-4637-a7ae-baabe29568f8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:49.257959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 580/1182] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:49 2022] GET /identity/v3/users/951f7d842ed043389ab01a2466ddefc0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:49.263855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccade226-d32b-44ad-bac9-702f5a61b16e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:49.292285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:49.361881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccade226-d32b-44ad-bac9-702f5a61b16e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:49.394819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587001b-a831-4ca9-87a4-209657df770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:49.395442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587001b-a831-4ca9-87a4-209657df770e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:49.395719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587001b-a831-4ca9-87a4-209657df770e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:49.395992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587001b-a831-4ca9-87a4-209657df770e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:49.460835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587001b-a831-4ca9-87a4-209657df770e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:49.462267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587001b-a831-4ca9-87a4-209657df770e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:49.487940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:49.556897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 603/1183] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:49.563450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067659-71ea-4637-a7ae-baabe29568f8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:49.659333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067659-71ea-4637-a7ae-baabe29568f8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:49.668530 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:49.693894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbf0a5-5deb-44ef-a02a-1a0ab36e484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:49.694517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbf0a5-5deb-44ef-a02a-1a0ab36e484a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:49.694797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbf0a5-5deb-44ef-a02a-1a0ab36e484a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:49.695100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbf0a5-5deb-44ef-a02a-1a0ab36e484a None admin] PATH_INFO: `/v3/projects/95ec4778cf804ef3891c967f89ce6d28` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:49.696212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbf0a5-5deb-44ef-a02a-1a0ab36e484a None admin] RBAC: Authorizing `identity:get_project(project_id=95ec4778cf804ef3891c967f89ce6d28)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:49.697635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbf0a5-5deb-44ef-a02a-1a0ab36e484a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:49.699293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 581/1184] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:49 2022] GET /identity/v3/projects/95ec4778cf804ef3891c967f89ce6d28 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:49.705480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587001b-a831-4ca9-87a4-209657df770e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:49.802293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587001b-a831-4ca9-87a4-209657df770e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:49.827758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:49.835511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cb9f5-e8d7-45e5-9f30-1647b75039f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:49.836109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cb9f5-e8d7-45e5-9f30-1647b75039f3 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:49.836387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cb9f5-e8d7-45e5-9f30-1647b75039f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:49.836661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cb9f5-e8d7-45e5-9f30-1647b75039f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:49.837377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cb9f5-e8d7-45e5-9f30-1647b75039f3 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=95ec4778cf804ef3891c967f89ce6d28, user.id=951f7d842ed043389ab01a2466ddefc0) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:49.837683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cb9f5-e8d7-45e5-9f30-1647b75039f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:49.839139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cb9f5-e8d7-45e5-9f30-1647b75039f3 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:49.844793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 604/1185] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:49 2022] GET /identity/v3/role_assignments?user.id=951f7d842ed043389ab01a2466ddefc0&scope.project.id=95ec4778cf804ef3891c967f89ce6d28&role.id=609b1a993a394f0e900e17edccebaea5 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:51.718237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3988-655c-442f-8547-36e41c7230be None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:51.718798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3988-655c-442f-8547-36e41c7230be None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:51.718798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3988-655c-442f-8547-36e41c7230be None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:51.720149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 582/1186] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:51.725525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d563c-d572-4529-bf7d-bc80863fd541 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:51.725957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d563c-d572-4529-bf7d-bc80863fd541 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:51.726071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d563c-d572-4529-bf7d-bc80863fd541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:51.750807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9b9d563c-d572-4529-bf7d-bc80863fd541 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:51.752154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9b9d563c-d572-4529-bf7d-bc80863fd541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:51.818494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 605/1187] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:52.085766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3988-655c-442f-8547-36e41c7230be None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:52.183868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3988-655c-442f-8547-36e41c7230be None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:52.215390 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216118ea-f043-4262-aa52-3f0435f3a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:52.216050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216118ea-f043-4262-aa52-3f0435f3a484 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:52.216331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216118ea-f043-4262-aa52-3f0435f3a484 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:52.216603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216118ea-f043-4262-aa52-3f0435f3a484 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:52.226766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216118ea-f043-4262-aa52-3f0435f3a484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-216118ea-f043-4262-aa52-3f0435f3a484 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:52.231396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:52.232329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:28:52.233910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 583/1188] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:52.240825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d563c-d572-4529-bf7d-bc80863fd541 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:52.338980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d563c-d572-4529-bf7d-bc80863fd541 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:52.362379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:52.374198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef98f8-5d5a-4709-ace1-95aa30ec3bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:52.374821 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef98f8-5d5a-4709-ace1-95aa30ec3bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:52.375137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef98f8-5d5a-4709-ace1-95aa30ec3bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:52.375412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef98f8-5d5a-4709-ace1-95aa30ec3bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:52.376084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef98f8-5d5a-4709-ace1-95aa30ec3bb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:52.376388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef98f8-5d5a-4709-ace1-95aa30ec3bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:52.377753 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef98f8-5d5a-4709-ace1-95aa30ec3bb1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:52.386240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 606/1189] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:52.392545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216118ea-f043-4262-aa52-3f0435f3a484 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:52.427401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:52.493683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216118ea-f043-4262-aa52-3f0435f3a484 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:52.535205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fdc12-9da2-4ca2-8653-a303f4b35239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:52.535829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fdc12-9da2-4ca2-8653-a303f4b35239 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:52.536108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fdc12-9da2-4ca2-8653-a303f4b35239 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:52.536382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fdc12-9da2-4ca2-8653-a303f4b35239 None admin] PATH_INFO: `/v3/users/951f7d842ed043389ab01a2466ddefc0` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:52.537495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fdc12-9da2-4ca2-8653-a303f4b35239 None admin] RBAC: Authorizing `identity:get_user(user_id=951f7d842ed043389ab01a2466ddefc0)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:52.539389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fdc12-9da2-4ca2-8653-a303f4b35239 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:52.540967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 584/1190] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:52 2022] GET /identity/v3/users/951f7d842ed043389ab01a2466ddefc0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:52.546989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef98f8-5d5a-4709-ace1-95aa30ec3bb1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:52.653777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef98f8-5d5a-4709-ace1-95aa30ec3bb1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:52.687113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634846db-996f-476a-b8f2-3e08a222892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:52.687741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634846db-996f-476a-b8f2-3e08a222892a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:52.688019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634846db-996f-476a-b8f2-3e08a222892a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:52.688288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634846db-996f-476a-b8f2-3e08a222892a None admin] PATH_INFO: `/v3/projects/95ec4778cf804ef3891c967f89ce6d28` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:52.689397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634846db-996f-476a-b8f2-3e08a222892a None admin] RBAC: Authorizing `identity:get_project(project_id=95ec4778cf804ef3891c967f89ce6d28)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:52.690817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634846db-996f-476a-b8f2-3e08a222892a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:52.692472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 607/1191] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:52 2022] GET /identity/v3/projects/95ec4778cf804ef3891c967f89ce6d28 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:52.698501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fdc12-9da2-4ca2-8653-a303f4b35239 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:52.805943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fdc12-9da2-4ca2-8653-a303f4b35239 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:52.808484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:52.841632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88d2fd-5940-49d5-b23d-6d36c11cfaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:52.842348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88d2fd-5940-49d5-b23d-6d36c11cfaff None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:52.842635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88d2fd-5940-49d5-b23d-6d36c11cfaff None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:52.842920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88d2fd-5940-49d5-b23d-6d36c11cfaff None admin] PATH_INFO: `/v3/projects/95ec4778cf804ef3891c967f89ce6d28/users/951f7d842ed043389ab01a2466ddefc0/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:52.844903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88d2fd-5940-49d5-b23d-6d36c11cfaff None admin] RBAC: Authorizing `identity:create_grant(project_id=95ec4778cf804ef3891c967f89ce6d28, user_id=951f7d842ed043389ab01a2466ddefc0, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:52.846339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88d2fd-5940-49d5-b23d-6d36c11cfaff None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:52.865938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 585/1192] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:28:52 2022] PUT /identity/v3/projects/95ec4778cf804ef3891c967f89ce6d28/users/951f7d842ed043389ab01a2466ddefc0/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:28:54.751044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a3a34-8fa6-469f-88cb-27d8eeaf662d None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:54.751602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a3a34-8fa6-469f-88cb-27d8eeaf662d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:54.751602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a3a34-8fa6-469f-88cb-27d8eeaf662d None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:54.752915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 608/1193] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:28:54.758285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb22d5e-2929-4984-a48b-591bf11b948f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:54.758694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb22d5e-2929-4984-a48b-591bf11b948f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:54.758836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb22d5e-2929-4984-a48b-591bf11b948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:54.778632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-9cb22d5e-2929-4984-a48b-591bf11b948f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:28:54.779865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9cb22d5e-2929-4984-a48b-591bf11b948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:28:54.847102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 586/1194] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:28:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:28:55.116453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a3a34-8fa6-469f-88cb-27d8eeaf662d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:55.170145 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:55.219619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a3a34-8fa6-469f-88cb-27d8eeaf662d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:55.253296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e228d5-fb40-44c7-b4f7-292c09da78b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:55.253917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e228d5-fb40-44c7-b4f7-292c09da78b9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:55.254195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e228d5-fb40-44c7-b4f7-292c09da78b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:55.254473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e228d5-fb40-44c7-b4f7-292c09da78b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:55.265365 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e228d5-fb40-44c7-b4f7-292c09da78b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-d3e228d5-fb40-44c7-b4f7-292c09da78b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:28:55.270085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:28:55.271225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:28:55.272264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 609/1195] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:28:55.277442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb22d5e-2929-4984-a48b-591bf11b948f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:55.375759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:55.383508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb22d5e-2929-4984-a48b-591bf11b948f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:55.417940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542bfc2-7b48-4a67-a0ec-7a2341ed2624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:55.418549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542bfc2-7b48-4a67-a0ec-7a2341ed2624 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:55.418832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542bfc2-7b48-4a67-a0ec-7a2341ed2624 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:55.419141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542bfc2-7b48-4a67-a0ec-7a2341ed2624 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:55.419810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542bfc2-7b48-4a67-a0ec-7a2341ed2624 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:55.420113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542bfc2-7b48-4a67-a0ec-7a2341ed2624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:55.422426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542bfc2-7b48-4a67-a0ec-7a2341ed2624 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:55.431100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 587/1196] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:55.437086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e228d5-fb40-44c7-b4f7-292c09da78b9 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:55.547375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e228d5-fb40-44c7-b4f7-292c09da78b9 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:55.560255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:55.581964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e2fd6-cf6f-4c9b-a7dc-f39f980b4f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:55.582596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e2fd6-cf6f-4c9b-a7dc-f39f980b4f4e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:55.582871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e2fd6-cf6f-4c9b-a7dc-f39f980b4f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:55.583188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e2fd6-cf6f-4c9b-a7dc-f39f980b4f4e None admin] PATH_INFO: `/v3/users/951f7d842ed043389ab01a2466ddefc0` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:55.584313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e2fd6-cf6f-4c9b-a7dc-f39f980b4f4e None admin] RBAC: Authorizing `identity:get_user(user_id=951f7d842ed043389ab01a2466ddefc0)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:55.585744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e2fd6-cf6f-4c9b-a7dc-f39f980b4f4e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:55.587379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 610/1197] 10.222.0.89 () {56 vars in 1177 bytes} [Fri Aug 26 15:28:55 2022] GET /identity/v3/users/951f7d842ed043389ab01a2466ddefc0 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:55.593979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542bfc2-7b48-4a67-a0ec-7a2341ed2624 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:55.694358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542bfc2-7b48-4a67-a0ec-7a2341ed2624 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:55.731821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe055688-98b9-4875-a3e2-2124c940f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:55.732425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe055688-98b9-4875-a3e2-2124c940f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:55.732710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe055688-98b9-4875-a3e2-2124c940f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:55.732983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe055688-98b9-4875-a3e2-2124c940f1d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:55.757548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:55.803399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe055688-98b9-4875-a3e2-2124c940f1d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:55.804863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe055688-98b9-4875-a3e2-2124c940f1d4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:55.905285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 588/1198] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:28:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:28:55.911416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e2fd6-cf6f-4c9b-a7dc-f39f980b4f4e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:56.012355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e2fd6-cf6f-4c9b-a7dc-f39f980b4f4e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:56.053600 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560896d-bd48-4c94-94a7-ad3f13bba2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:56.054223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560896d-bd48-4c94-94a7-ad3f13bba2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:56.054502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560896d-bd48-4c94-94a7-ad3f13bba2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:56.054774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560896d-bd48-4c94-94a7-ad3f13bba2a9 None admin] PATH_INFO: `/v3/projects/95ec4778cf804ef3891c967f89ce6d28` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:56.055918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560896d-bd48-4c94-94a7-ad3f13bba2a9 None admin] RBAC: Authorizing `identity:get_project(project_id=95ec4778cf804ef3891c967f89ce6d28)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:56.057346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560896d-bd48-4c94-94a7-ad3f13bba2a9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:56.059000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 611/1199] 10.222.0.89 () {56 vars in 1186 bytes} [Fri Aug 26 15:28:55 2022] GET /identity/v3/projects/95ec4778cf804ef3891c967f89ce6d28 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:28:56.065199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe055688-98b9-4875-a3e2-2124c940f1d4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:28:56.120529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:28:56.166427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe055688-98b9-4875-a3e2-2124c940f1d4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:28:56.199998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b41678-c12c-4d51-9379-919fda06e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:28:56.200598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b41678-c12c-4d51-9379-919fda06e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:28:56.200876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b41678-c12c-4d51-9379-919fda06e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:28:56.201141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b41678-c12c-4d51-9379-919fda06e1d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:28:56.202400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b41678-c12c-4d51-9379-919fda06e1d0 None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=95ec4778cf804ef3891c967f89ce6d28, user.id=951f7d842ed043389ab01a2466ddefc0) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:28:56.202703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b41678-c12c-4d51-9379-919fda06e1d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:28:56.204161 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b41678-c12c-4d51-9379-919fda06e1d0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:28:56.210423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 589/1200] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:28:56 2022] GET /identity/v3/role_assignments?user.id=951f7d842ed043389ab01a2466ddefc0&scope.project.id=95ec4778cf804ef3891c967f89ce6d28&role.id=609b1a993a394f0e900e17edccebaea5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:06.049627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=76 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:06.207438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=40 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:51.949559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99039-b250-49e3-9de2-e2f8661ba5a3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:51.950136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99039-b250-49e3-9de2-e2f8661ba5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:51.950136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99039-b250-49e3-9de2-e2f8661ba5a3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:51.952039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 612/1201] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:29:51.958065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714d6a8-d8c5-4ad2-9952-51676885c250 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:51.958532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714d6a8-d8c5-4ad2-9952-51676885c250 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:51.958621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714d6a8-d8c5-4ad2-9952-51676885c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:51.979159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8714d6a8-d8c5-4ad2-9952-51676885c250 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:29:51.980442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8714d6a8-d8c5-4ad2-9952-51676885c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:29:52.067038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 590/1202] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:29:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:29:52.365370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99039-b250-49e3-9de2-e2f8661ba5a3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:52.509860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99039-b250-49e3-9de2-e2f8661ba5a3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:52.557206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b1caf-0df2-4cbc-95e5-ebe79f18ddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:52.559677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b1caf-0df2-4cbc-95e5-ebe79f18ddf2 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:52.559982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b1caf-0df2-4cbc-95e5-ebe79f18ddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:52.560263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b1caf-0df2-4cbc-95e5-ebe79f18ddf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:52.576519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b1caf-0df2-4cbc-95e5-ebe79f18ddf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:52.576889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b1caf-0df2-4cbc-95e5-ebe79f18ddf2 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-cb9b1caf-0df2-4cbc-95e5-ebe79f18ddf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:29:52.594358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:52.595547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:29:52.596519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:29:52.596519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:52.596519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:29:52.596519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 613/1203] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:29:52.602698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714d6a8-d8c5-4ad2-9952-51676885c250 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:52.749935 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714d6a8-d8c5-4ad2-9952-51676885c250 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:52.793012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:52.804652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac3819-71a1-471f-b87b-49d470b17ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:52.805352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3819-71a1-471f-b87b-49d470b17ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:52.807090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3819-71a1-471f-b87b-49d470b17ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:52.807090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3819-71a1-471f-b87b-49d470b17ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:52.807090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac3819-71a1-471f-b87b-49d470b17ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:52.807090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac3819-71a1-471f-b87b-49d470b17ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:52.808572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac3819-71a1-471f-b87b-49d470b17ca7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:52.826350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 591/1204] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:52.832679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b1caf-0df2-4cbc-95e5-ebe79f18ddf2 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:52.904078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:52.959925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b1caf-0df2-4cbc-95e5-ebe79f18ddf2 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:53.007603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d14a40-8779-448e-b1b5-79d940bf7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:53.008198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d14a40-8779-448e-b1b5-79d940bf7f24 None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:53.008482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d14a40-8779-448e-b1b5-79d940bf7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:53.008808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d14a40-8779-448e-b1b5-79d940bf7f24 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:53.009828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d14a40-8779-448e-b1b5-79d940bf7f24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:53.011759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d14a40-8779-448e-b1b5-79d940bf7f24 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:53.054963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 614/1205] 10.222.0.89 () {60 vars in 1132 bytes} [Fri Aug 26 15:29:52 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:29:55.405460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656e8da-a024-4164-9b02-c48d2c456c95 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:55.406013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656e8da-a024-4164-9b02-c48d2c456c95 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:55.406013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656e8da-a024-4164-9b02-c48d2c456c95 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:55.407658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 592/1206] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:29:55.414211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca58e1d-e7d3-4868-b380-ba793a68d17b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:55.414713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca58e1d-e7d3-4868-b380-ba793a68d17b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:55.415292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca58e1d-e7d3-4868-b380-ba793a68d17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:55.438512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0ca58e1d-e7d3-4868-b380-ba793a68d17b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:29:55.439751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0ca58e1d-e7d3-4868-b380-ba793a68d17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:29:55.519886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 615/1207] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:29:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:29:55.793065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656e8da-a024-4164-9b02-c48d2c456c95 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:55.917068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656e8da-a024-4164-9b02-c48d2c456c95 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:55.959634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4644802-419d-45be-a995-8aa39ddc6e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:55.960310 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4644802-419d-45be-a995-8aa39ddc6e84 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:55.960700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4644802-419d-45be-a995-8aa39ddc6e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:55.960867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4644802-419d-45be-a995-8aa39ddc6e84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:55.973888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4644802-419d-45be-a995-8aa39ddc6e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-f4644802-419d-45be-a995-8aa39ddc6e84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:29:55.978725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:55.980126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:29:55.981262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 593/1208] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:29:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:29:55.988517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca58e1d-e7d3-4868-b380-ba793a68d17b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:56.034980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:56.112286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca58e1d-e7d3-4868-b380-ba793a68d17b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:56.168170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20286a6-9bc6-477f-bd55-924a57350bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:56.168903 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20286a6-9bc6-477f-bd55-924a57350bbf None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:56.169192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20286a6-9bc6-477f-bd55-924a57350bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:56.169468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20286a6-9bc6-477f-bd55-924a57350bbf None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:56.170204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20286a6-9bc6-477f-bd55-924a57350bbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:56.170510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20286a6-9bc6-477f-bd55-924a57350bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:56.171947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20286a6-9bc6-477f-bd55-924a57350bbf None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:56.187136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 616/1209] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:29:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:56.188592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4644802-419d-45be-a995-8aa39ddc6e84 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:56.245565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:56.302254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4644802-419d-45be-a995-8aa39ddc6e84 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:56.343696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978e9d8-9bb9-4206-b45a-90440ea91ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:56.344367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978e9d8-9bb9-4206-b45a-90440ea91ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:56.344647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978e9d8-9bb9-4206-b45a-90440ea91ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:56.344918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978e9d8-9bb9-4206-b45a-90440ea91ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:56.356261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978e9d8-9bb9-4206-b45a-90440ea91ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:56.359113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978e9d8-9bb9-4206-b45a-90440ea91ff0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-a978e9d8-9bb9-4206-b45a-90440ea91ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:29:56.377691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:56.378817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:29:56.380035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:29:56.380035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:56.380035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:29:56.380035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 594/1210] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:29:56.384962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20286a6-9bc6-477f-bd55-924a57350bbf None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:56.508690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:56.512895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20286a6-9bc6-477f-bd55-924a57350bbf None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:56.556535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c16af8-7820-4647-b231-e9b364045892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:56.557550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c16af8-7820-4647-b231-e9b364045892 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:56.557550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c16af8-7820-4647-b231-e9b364045892 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:56.558036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c16af8-7820-4647-b231-e9b364045892 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:56.558764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c16af8-7820-4647-b231-e9b364045892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:56.559099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c16af8-7820-4647-b231-e9b364045892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:56.560462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c16af8-7820-4647-b231-e9b364045892 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:56.574998 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 617/1211] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:56.582392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978e9d8-9bb9-4206-b45a-90440ea91ff0 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:56.693052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978e9d8-9bb9-4206-b45a-90440ea91ff0 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:56.696033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:56.732418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bccda-6ee3-46c6-9d14-64918ff2e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:56.733052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bccda-6ee3-46c6-9d14-64918ff2e987 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:56.733389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bccda-6ee3-46c6-9d14-64918ff2e987 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:56.733642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bccda-6ee3-46c6-9d14-64918ff2e987 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:56.741491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bccda-6ee3-46c6-9d14-64918ff2e987 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:56.742997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bccda-6ee3-46c6-9d14-64918ff2e987 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-ee7bccda-6ee3-46c6-9d14-64918ff2e987 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:29:56.757226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:56.758489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:29:56.760618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 595/1212] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:29:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:29:56.764468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c16af8-7820-4647-b231-e9b364045892 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:56.891511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c16af8-7820-4647-b231-e9b364045892 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:56.929551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfb6cb-299b-4e5b-b77f-b944572a67f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:56.930470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfb6cb-299b-4e5b-b77f-b944572a67f5 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:56.930747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfb6cb-299b-4e5b-b77f-b944572a67f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:56.931055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfb6cb-299b-4e5b-b77f-b944572a67f5 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:56.931845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfb6cb-299b-4e5b-b77f-b944572a67f5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:56.932134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfb6cb-299b-4e5b-b77f-b944572a67f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:56.933623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfb6cb-299b-4e5b-b77f-b944572a67f5 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:56.955090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 618/1213] 10.222.0.89 () {56 vars in 1143 bytes} [Fri Aug 26 15:29:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:29:56.961112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bccda-6ee3-46c6-9d14-64918ff2e987 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:57.087588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bccda-6ee3-46c6-9d14-64918ff2e987 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:57.128672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3254da-86dc-4185-be9b-1caadb80b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:57.129289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3254da-86dc-4185-be9b-1caadb80b4dd None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:57.129691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3254da-86dc-4185-be9b-1caadb80b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:57.129971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3254da-86dc-4185-be9b-1caadb80b4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:57.167143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:57.219182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3254da-86dc-4185-be9b-1caadb80b4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:57.220858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3254da-86dc-4185-be9b-1caadb80b4dd None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:57.348118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 596/1214] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:29:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:29:57.349562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfb6cb-299b-4e5b-b77f-b944572a67f5 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:57.374206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:57.477227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfb6cb-299b-4e5b-b77f-b944572a67f5 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:57.541512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47389fb8-d0af-49ad-9f01-512343f6fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:57.542919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47389fb8-d0af-49ad-9f01-512343f6fa6a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:57.543632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47389fb8-d0af-49ad-9f01-512343f6fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:57.544304 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47389fb8-d0af-49ad-9f01-512343f6fa6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:57.562182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47389fb8-d0af-49ad-9f01-512343f6fa6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:57.564999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47389fb8-d0af-49ad-9f01-512343f6fa6a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-47389fb8-d0af-49ad-9f01-512343f6fa6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:29:57.586094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:57.587334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:29:57.588436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:29:57.588436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:29:57.588436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:29:57.595130 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 619/1215] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:29:57.596198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3254da-86dc-4185-be9b-1caadb80b4dd None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:57.662641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:57.708300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3254da-86dc-4185-be9b-1caadb80b4dd None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:57.747460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df91b29-a637-4330-9454-a1423e92c939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:57.747995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df91b29-a637-4330-9454-a1423e92c939 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:57.748335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df91b29-a637-4330-9454-a1423e92c939 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:57.748613 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df91b29-a637-4330-9454-a1423e92c939 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:57.749298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df91b29-a637-4330-9454-a1423e92c939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:57.749705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df91b29-a637-4330-9454-a1423e92c939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:57.750953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df91b29-a637-4330-9454-a1423e92c939 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:57.768189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 597/1216] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:29:57.769597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47389fb8-d0af-49ad-9f01-512343f6fa6a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:57.858192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:57.902994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47389fb8-d0af-49ad-9f01-512343f6fa6a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:57.942712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b1e55-e8cb-4c6e-b536-2bfc60e70545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:57.943391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b1e55-e8cb-4c6e-b536-2bfc60e70545 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:57.943706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b1e55-e8cb-4c6e-b536-2bfc60e70545 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:57.943964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b1e55-e8cb-4c6e-b536-2bfc60e70545 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:57.951067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b1e55-e8cb-4c6e-b536-2bfc60e70545 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:57.953049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b1e55-e8cb-4c6e-b536-2bfc60e70545 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a64b1e55-e8cb-4c6e-b536-2bfc60e70545 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:29:57.965506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:29:57.972388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:29:57.973606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:29:57.973606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:29:57.973606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:29:57.973606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:29:57.973606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:29:57.973606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:29:57.973606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:29:57.973606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:29:57.973606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 620/1217] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:29:57.974206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df91b29-a637-4330-9454-a1423e92c939 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:58.085541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df91b29-a637-4330-9454-a1423e92c939 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:58.112828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:58.131388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c215-5abf-454a-af16-0a9ad6b09877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:58.132017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c215-5abf-454a-af16-0a9ad6b09877 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:58.132304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c215-5abf-454a-af16-0a9ad6b09877 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:58.132583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c215-5abf-454a-af16-0a9ad6b09877 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:58.133300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c215-5abf-454a-af16-0a9ad6b09877 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:58.133613 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c215-5abf-454a-af16-0a9ad6b09877 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:58.135100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c215-5abf-454a-af16-0a9ad6b09877 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:58.151757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 598/1218] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:29:58.160310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b1e55-e8cb-4c6e-b536-2bfc60e70545 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:29:58.284777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b1e55-e8cb-4c6e-b536-2bfc60e70545 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:29:58.314287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:29:58.320991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042419b0-6a82-4277-8c04-9d00888c7cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:29:58.321684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042419b0-6a82-4277-8c04-9d00888c7cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:29:58.322037 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042419b0-6a82-4277-8c04-9d00888c7cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:29:58.322374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042419b0-6a82-4277-8c04-9d00888c7cc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:29:58.323223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042419b0-6a82-4277-8c04-9d00888c7cc9 None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=8d086e815c1542d1ba9daf81e644166a) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:29:58.323676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042419b0-6a82-4277-8c04-9d00888c7cc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:29:58.325101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042419b0-6a82-4277-8c04-9d00888c7cc9 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:29:58.330902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 621/1219] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:29:58 2022] GET /identity/v3/role_assignments?user.id=8d086e815c1542d1ba9daf81e644166a&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:00.429698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b595-e539-4053-a726-6a7e5d98bf76 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:00.430238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b595-e539-4053-a726-6a7e5d98bf76 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:00.430238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b595-e539-4053-a726-6a7e5d98bf76 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:00.431620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 599/1220] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:00.438046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de611d-cbae-419d-9c33-a830c8b47a37 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:00.438568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de611d-cbae-419d-9c33-a830c8b47a37 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:00.438674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de611d-cbae-419d-9c33-a830c8b47a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:00.459441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c5de611d-cbae-419d-9c33-a830c8b47a37 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:00.460764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c5de611d-cbae-419d-9c33-a830c8b47a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:00.536352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 622/1221] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:00.826699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b595-e539-4053-a726-6a7e5d98bf76 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:00.937688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b595-e539-4053-a726-6a7e5d98bf76 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:00.972899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b162c-620d-45ca-b2b1-731ffd18ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:00.973772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b162c-620d-45ca-b2b1-731ffd18ee47 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:00.974052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b162c-620d-45ca-b2b1-731ffd18ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:00.974345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b162c-620d-45ca-b2b1-731ffd18ee47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:00.988341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b162c-620d-45ca-b2b1-731ffd18ee47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-5a7b162c-620d-45ca-b2b1-731ffd18ee47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:00.993089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:00.995004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:00.996108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 600/1222] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:01.001179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de611d-cbae-419d-9c33-a830c8b47a37 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:01.113544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de611d-cbae-419d-9c33-a830c8b47a37 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:01.143850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:01.156431 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45cad-26c4-45d7-9370-e15ed995736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:01.157083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45cad-26c4-45d7-9370-e15ed995736c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:01.157345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45cad-26c4-45d7-9370-e15ed995736c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:01.157619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45cad-26c4-45d7-9370-e15ed995736c None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:01.158307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a45cad-26c4-45d7-9370-e15ed995736c None admin] RBAC: Adding query filter params (name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:01.158614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a45cad-26c4-45d7-9370-e15ed995736c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:01.160044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a45cad-26c4-45d7-9370-e15ed995736c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:01.168958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 623/1223] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:30:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:01.174723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b162c-620d-45ca-b2b1-731ffd18ee47 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:01.225776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:01.284695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b162c-620d-45ca-b2b1-731ffd18ee47 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:01.320431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2104e1-60ad-47f6-ba77-7cd48cca6e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:01.321062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2104e1-60ad-47f6-ba77-7cd48cca6e9c None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:01.321339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2104e1-60ad-47f6-ba77-7cd48cca6e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:01.321612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2104e1-60ad-47f6-ba77-7cd48cca6e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:01.332121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2104e1-60ad-47f6-ba77-7cd48cca6e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:01.333517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2104e1-60ad-47f6-ba77-7cd48cca6e9c None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-6a2104e1-60ad-47f6-ba77-7cd48cca6e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:01.349443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:01.351826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:01.353757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:01.353757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:01.353757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:01.355362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 601/1224] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:01.356686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45cad-26c4-45d7-9370-e15ed995736c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:01.475788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45cad-26c4-45d7-9370-e15ed995736c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:01.510794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c58a3-f70a-404f-8f1e-e8cbf8e16e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:01.511484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c58a3-f70a-404f-8f1e-e8cbf8e16e56 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:01.511780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c58a3-f70a-404f-8f1e-e8cbf8e16e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:01.512042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c58a3-f70a-404f-8f1e-e8cbf8e16e56 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:01.512753 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c58a3-f70a-404f-8f1e-e8cbf8e16e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:01.513080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c58a3-f70a-404f-8f1e-e8cbf8e16e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:01.515069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c58a3-f70a-404f-8f1e-e8cbf8e16e56 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:01.527807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 624/1225] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:01.534013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2104e1-60ad-47f6-ba77-7cd48cca6e9c None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:01.633854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:01.642849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2104e1-60ad-47f6-ba77-7cd48cca6e9c None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:01.681252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f776f0-dfd5-4113-89b5-412e78919df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:01.682086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f776f0-dfd5-4113-89b5-412e78919df1 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:01.682632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f776f0-dfd5-4113-89b5-412e78919df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:01.682919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f776f0-dfd5-4113-89b5-412e78919df1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:01.692790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f776f0-dfd5-4113-89b5-412e78919df1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:01.694324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f776f0-dfd5-4113-89b5-412e78919df1 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-a3f776f0-dfd5-4113-89b5-412e78919df1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:01.707244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:01.708446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:01.709456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 602/1226] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:01.714722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c58a3-f70a-404f-8f1e-e8cbf8e16e56 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:01.770084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:01.831208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c58a3-f70a-404f-8f1e-e8cbf8e16e56 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:01.869922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857bdba-71c6-4115-8f67-19ded950ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:01.870676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857bdba-71c6-4115-8f67-19ded950ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:01.871027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857bdba-71c6-4115-8f67-19ded950ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:01.871364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857bdba-71c6-4115-8f67-19ded950ebf8 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:01.872172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857bdba-71c6-4115-8f67-19ded950ebf8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:01.872553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857bdba-71c6-4115-8f67-19ded950ebf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:01.874210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857bdba-71c6-4115-8f67-19ded950ebf8 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:01.894090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 625/1227] 10.222.0.89 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:01.899864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f776f0-dfd5-4113-89b5-412e78919df1 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:02.009352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f776f0-dfd5-4113-89b5-412e78919df1 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:02.048434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff99a38-856b-497f-ace4-462871470a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:02.049085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99a38-856b-497f-ace4-462871470a0e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:02.049407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99a38-856b-497f-ace4-462871470a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:02.049686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99a38-856b-497f-ace4-462871470a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:02.062228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff99a38-856b-497f-ace4-462871470a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:02.063719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff99a38-856b-497f-ace4-462871470a0e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-eff99a38-856b-497f-ace4-462871470a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:02.077738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:02.078923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:02.080353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:02.080353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:02.080353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:02.080353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 603/1228] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:02.085089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857bdba-71c6-4115-8f67-19ded950ebf8 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:02.197755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857bdba-71c6-4115-8f67-19ded950ebf8 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:02.200299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:02.236191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73df6c-7b32-4c59-bdc6-802b54f43cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:02.236847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73df6c-7b32-4c59-bdc6-802b54f43cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:02.237125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73df6c-7b32-4c59-bdc6-802b54f43cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:02.237405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73df6c-7b32-4c59-bdc6-802b54f43cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:02.238050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73df6c-7b32-4c59-bdc6-802b54f43cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:02.238356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73df6c-7b32-4c59-bdc6-802b54f43cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:02.239768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73df6c-7b32-4c59-bdc6-802b54f43cb1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:02.253040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 626/1229] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:02.259688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff99a38-856b-497f-ace4-462871470a0e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:02.270309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:02.375034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff99a38-856b-497f-ace4-462871470a0e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:02.411943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e20ca2-14d5-4157-9914-7a896a57d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:02.412587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e20ca2-14d5-4157-9914-7a896a57d076 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:02.412873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e20ca2-14d5-4157-9914-7a896a57d076 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:02.413180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e20ca2-14d5-4157-9914-7a896a57d076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:02.421034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e20ca2-14d5-4157-9914-7a896a57d076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:02.422562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e20ca2-14d5-4157-9914-7a896a57d076 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-96e20ca2-14d5-4157-9914-7a896a57d076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:02.434350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:02.435450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:02.437007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:02.437007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:02.437007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:02.437007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:02.437007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:02.437007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:02.437007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:02.437007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:02.437007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 604/1230] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:30:02.442184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73df6c-7b32-4c59-bdc6-802b54f43cb1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:02.550628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73df6c-7b32-4c59-bdc6-802b54f43cb1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:02.588128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaa53a-a995-4e77-9797-8473f091508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:02.588759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaa53a-a995-4e77-9797-8473f091508c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:02.589125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaa53a-a995-4e77-9797-8473f091508c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:02.589455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaa53a-a995-4e77-9797-8473f091508c None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:02.590248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaa53a-a995-4e77-9797-8473f091508c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:02.590669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaa53a-a995-4e77-9797-8473f091508c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:02.593584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaa53a-a995-4e77-9797-8473f091508c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:02.606907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 627/1231] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:02.613852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e20ca2-14d5-4157-9914-7a896a57d076 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:02.681912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:02.725002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e20ca2-14d5-4157-9914-7a896a57d076 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:02.762756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98611a27-2533-4d36-ada9-522a5d7da7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:02.765338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98611a27-2533-4d36-ada9-522a5d7da7f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:02.765338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98611a27-2533-4d36-ada9-522a5d7da7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:02.765338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98611a27-2533-4d36-ada9-522a5d7da7f3 None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/8d086e815c1542d1ba9daf81e644166a/roles/90c85626d318449cb55d5c2bc0b2e18d` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:02.787177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98611a27-2533-4d36-ada9-522a5d7da7f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=8d086e815c1542d1ba9daf81e644166a, role_id=90c85626d318449cb55d5c2bc0b2e18d)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:02.788710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98611a27-2533-4d36-ada9-522a5d7da7f3 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:02.803033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 605/1232] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:30:02 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/8d086e815c1542d1ba9daf81e644166a/roles/90c85626d318449cb55d5c2bc0b2e18d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:30:04.805520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a3734-5f96-4124-8545-55f0b9aaa105 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:04.805993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a3734-5f96-4124-8545-55f0b9aaa105 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:04.806165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a3734-5f96-4124-8545-55f0b9aaa105 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:04.807664 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 628/1233] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:04.813957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bf257-57fd-4d8a-8e73-c67b9c17be7d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:04.814455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bf257-57fd-4d8a-8e73-c67b9c17be7d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:04.814552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bf257-57fd-4d8a-8e73-c67b9c17be7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:04.836227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f40bf257-57fd-4d8a-8e73-c67b9c17be7d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:04.837458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f40bf257-57fd-4d8a-8e73-c67b9c17be7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:04.924573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 606/1234] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:05.218355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a3734-5f96-4124-8545-55f0b9aaa105 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:05.249020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:05.335317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a3734-5f96-4124-8545-55f0b9aaa105 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:05.373411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504ac92-e6f3-4405-b058-8bb90ba5d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:05.374043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504ac92-e6f3-4405-b058-8bb90ba5d57c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:05.374319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504ac92-e6f3-4405-b058-8bb90ba5d57c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:05.374586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504ac92-e6f3-4405-b058-8bb90ba5d57c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:05.386217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504ac92-e6f3-4405-b058-8bb90ba5d57c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-6504ac92-e6f3-4405-b058-8bb90ba5d57c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:05.392953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:05.393939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:05.394795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 629/1235] 10.222.0.89 () {56 vars in 1102 bytes} [Fri Aug 26 15:30:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:05.400948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bf257-57fd-4d8a-8e73-c67b9c17be7d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:05.459616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:05.522308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bf257-57fd-4d8a-8e73-c67b9c17be7d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:05.561252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85c1d4-c14d-4f60-8f60-e9d230b3e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:05.561880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85c1d4-c14d-4f60-8f60-e9d230b3e037 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:05.562161 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85c1d4-c14d-4f60-8f60-e9d230b3e037 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:05.562430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85c1d4-c14d-4f60-8f60-e9d230b3e037 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:05.563275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85c1d4-c14d-4f60-8f60-e9d230b3e037 None admin] RBAC: Adding query filter params (name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:05.563442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85c1d4-c14d-4f60-8f60-e9d230b3e037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:05.564816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85c1d4-c14d-4f60-8f60-e9d230b3e037 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:05.574337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 607/1236] 10.222.0.89 () {56 vars in 1103 bytes} [Fri Aug 26 15:30:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:05.580240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504ac92-e6f3-4405-b058-8bb90ba5d57c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:05.678002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:05.694877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504ac92-e6f3-4405-b058-8bb90ba5d57c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:05.734385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa25fb3-3dba-4316-bab6-8035d28e1f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:05.735124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa25fb3-3dba-4316-bab6-8035d28e1f31 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:05.735403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa25fb3-3dba-4316-bab6-8035d28e1f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:05.735672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa25fb3-3dba-4316-bab6-8035d28e1f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:05.747404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa25fb3-3dba-4316-bab6-8035d28e1f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:05.748966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa25fb3-3dba-4316-bab6-8035d28e1f31 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-9aa25fb3-3dba-4316-bab6-8035d28e1f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:05.765134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:05.766666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:05.767889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:05.767889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:05.767889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:05.767889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 630/1237] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:05.773033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85c1d4-c14d-4f60-8f60-e9d230b3e037 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:05.894963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85c1d4-c14d-4f60-8f60-e9d230b3e037 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:05.907491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:05.934133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30868da-b6b2-44b8-8b3e-9dbd8d15faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:05.934755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30868da-b6b2-44b8-8b3e-9dbd8d15faa4 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:05.935076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30868da-b6b2-44b8-8b3e-9dbd8d15faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:05.935358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30868da-b6b2-44b8-8b3e-9dbd8d15faa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:05.936431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30868da-b6b2-44b8-8b3e-9dbd8d15faa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:05.936744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30868da-b6b2-44b8-8b3e-9dbd8d15faa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:05.938571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30868da-b6b2-44b8-8b3e-9dbd8d15faa4 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:05.953484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 608/1238] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:05.959233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa25fb3-3dba-4316-bab6-8035d28e1f31 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:06.064044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa25fb3-3dba-4316-bab6-8035d28e1f31 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:06.101343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fdc91-f14d-44d6-b8f6-1368f3338620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:06.102008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fdc91-f14d-44d6-b8f6-1368f3338620 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:06.102342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fdc91-f14d-44d6-b8f6-1368f3338620 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:06.102618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fdc91-f14d-44d6-b8f6-1368f3338620 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:06.105542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:06.112170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fdc91-f14d-44d6-b8f6-1368f3338620 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:06.114024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fdc91-f14d-44d6-b8f6-1368f3338620 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e93fdc91-f14d-44d6-b8f6-1368f3338620 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:06.129058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:06.130282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:06.131259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 631/1239] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:30:06.136301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30868da-b6b2-44b8-8b3e-9dbd8d15faa4 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:06.249654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30868da-b6b2-44b8-8b3e-9dbd8d15faa4 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:06.287086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bd01a-1301-4322-b0ca-e16dbda57cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:06.287711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bd01a-1301-4322-b0ca-e16dbda57cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:06.287993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bd01a-1301-4322-b0ca-e16dbda57cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:06.288271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bd01a-1301-4322-b0ca-e16dbda57cf0 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:06.289013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bd01a-1301-4322-b0ca-e16dbda57cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:06.289327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bd01a-1301-4322-b0ca-e16dbda57cf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:06.290775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bd01a-1301-4322-b0ca-e16dbda57cf0 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:06.310269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 609/1240] 10.222.0.89 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:06.317207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fdc91-f14d-44d6-b8f6-1368f3338620 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:06.430466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fdc91-f14d-44d6-b8f6-1368f3338620 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:06.468463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b7e8b-1267-4099-9a37-89f13547ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:06.469082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b7e8b-1267-4099-9a37-89f13547ed1e None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:06.469363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b7e8b-1267-4099-9a37-89f13547ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:06.469653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b7e8b-1267-4099-9a37-89f13547ed1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:06.537959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:06.545782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b7e8b-1267-4099-9a37-89f13547ed1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:06.547257 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b7e8b-1267-4099-9a37-89f13547ed1e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:06.648581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 632/1241] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:30:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:30:06.655627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bd01a-1301-4322-b0ca-e16dbda57cf0 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:06.686542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:06.762330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bd01a-1301-4322-b0ca-e16dbda57cf0 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:06.798646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159ddc-22b6-4822-b6b5-ccfe4fd5f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:06.800188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159ddc-22b6-4822-b6b5-ccfe4fd5f593 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:06.800188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159ddc-22b6-4822-b6b5-ccfe4fd5f593 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:06.800188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159ddc-22b6-4822-b6b5-ccfe4fd5f593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:06.811935 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb159ddc-22b6-4822-b6b5-ccfe4fd5f593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:06.813582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb159ddc-22b6-4822-b6b5-ccfe4fd5f593 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-bb159ddc-22b6-4822-b6b5-ccfe4fd5f593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:06.830901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:06.832159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:06.833432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:06.833432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:06.833432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:06.833432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 610/1242] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:06.838134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b7e8b-1267-4099-9a37-89f13547ed1e None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:06.946658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:06.953114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b7e8b-1267-4099-9a37-89f13547ed1e None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:06.991307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c59686-824d-42b6-90da-4b81f153da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:06.992007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c59686-824d-42b6-90da-4b81f153da2f None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:06.992193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c59686-824d-42b6-90da-4b81f153da2f None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:06.992465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c59686-824d-42b6-90da-4b81f153da2f None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:06.993118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c59686-824d-42b6-90da-4b81f153da2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:06.993418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c59686-824d-42b6-90da-4b81f153da2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:06.994788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c59686-824d-42b6-90da-4b81f153da2f None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:07.007162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 633/1243] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:07.013033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159ddc-22b6-4822-b6b5-ccfe4fd5f593 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:07.096980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:07.122529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159ddc-22b6-4822-b6b5-ccfe4fd5f593 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:07.167716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7281f-cd33-4580-bd51-53c7ca333d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:07.168720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7281f-cd33-4580-bd51-53c7ca333d6f None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:07.169200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7281f-cd33-4580-bd51-53c7ca333d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:07.169690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7281f-cd33-4580-bd51-53c7ca333d6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:07.182649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7281f-cd33-4580-bd51-53c7ca333d6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:07.184284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7281f-cd33-4580-bd51-53c7ca333d6f None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-b1b7281f-cd33-4580-bd51-53c7ca333d6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:07.197665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:07.207938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:07.209694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:07.209694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:07.209694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:07.209694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:07.209694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:07.209694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:07.209694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:07.209694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:07.209694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 611/1244] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:07.210592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c59686-824d-42b6-90da-4b81f153da2f None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:07.325664 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c59686-824d-42b6-90da-4b81f153da2f None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:07.364357 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d49109-818d-49a5-ab5f-e60c355656da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:07.364966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d49109-818d-49a5-ab5f-e60c355656da None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:07.365245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d49109-818d-49a5-ab5f-e60c355656da None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:07.365517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d49109-818d-49a5-ab5f-e60c355656da None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:07.366208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d49109-818d-49a5-ab5f-e60c355656da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:07.366513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d49109-818d-49a5-ab5f-e60c355656da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:07.367965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d49109-818d-49a5-ab5f-e60c355656da None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:07.386516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 634/1245] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:07.387992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7281f-cd33-4580-bd51-53c7ca333d6f None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:07.500876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7281f-cd33-4580-bd51-53c7ca333d6f None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:07.540918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70349f-51bb-46e8-8f15-e905bfc0920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:07.541615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70349f-51bb-46e8-8f15-e905bfc0920d None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:07.541817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70349f-51bb-46e8-8f15-e905bfc0920d None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:07.542079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70349f-51bb-46e8-8f15-e905bfc0920d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:07.542815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70349f-51bb-46e8-8f15-e905bfc0920d None admin] RBAC: Adding query filter params (role.id=90c85626d318449cb55d5c2bc0b2e18d, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=8d086e815c1542d1ba9daf81e644166a) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:07.543152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70349f-51bb-46e8-8f15-e905bfc0920d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:07.544580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70349f-51bb-46e8-8f15-e905bfc0920d None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:07.551184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 612/1246] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:30:07 2022] GET /identity/v3/role_assignments?user.id=8d086e815c1542d1ba9daf81e644166a&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=90c85626d318449cb55d5c2bc0b2e18d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:09.763541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2183ae-4630-436e-a7d7-a7d5dfa028de None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:09.764084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2183ae-4630-436e-a7d7-a7d5dfa028de None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:09.764520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2183ae-4630-436e-a7d7-a7d5dfa028de None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:09.765479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 635/1247] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:09.771090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d59037-617f-4d7f-ad0a-194944456dc7 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:09.771558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d59037-617f-4d7f-ad0a-194944456dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:09.771808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d59037-617f-4d7f-ad0a-194944456dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:09.779937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:09.795690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c1d59037-617f-4d7f-ad0a-194944456dc7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:09.797031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c1d59037-617f-4d7f-ad0a-194944456dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:09.881235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 613/1248] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:10.189158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2183ae-4630-436e-a7d7-a7d5dfa028de None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:10.212434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:10.313123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2183ae-4630-436e-a7d7-a7d5dfa028de None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:10.350942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8c5fa-bd3a-4df3-89ca-8ec2eb9417a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:10.351599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8c5fa-bd3a-4df3-89ca-8ec2eb9417a4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:10.351905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8c5fa-bd3a-4df3-89ca-8ec2eb9417a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:10.352180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8c5fa-bd3a-4df3-89ca-8ec2eb9417a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:10.364847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8c5fa-bd3a-4df3-89ca-8ec2eb9417a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-55a8c5fa-bd3a-4df3-89ca-8ec2eb9417a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:10.370399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:10.371768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:10.372994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 636/1249] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:30:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:30:10.378650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d59037-617f-4d7f-ad0a-194944456dc7 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:10.494483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d59037-617f-4d7f-ad0a-194944456dc7 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:10.526432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:10.531975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2890015-6d6a-4564-90c6-9d16a56280ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:10.532742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2890015-6d6a-4564-90c6-9d16a56280ad None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:10.533139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2890015-6d6a-4564-90c6-9d16a56280ad None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:10.533436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2890015-6d6a-4564-90c6-9d16a56280ad None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:10.534350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2890015-6d6a-4564-90c6-9d16a56280ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:10.534698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2890015-6d6a-4564-90c6-9d16a56280ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:10.536240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2890015-6d6a-4564-90c6-9d16a56280ad None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:10.546609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 614/1250] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:30:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:10.552667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8c5fa-bd3a-4df3-89ca-8ec2eb9417a4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:10.644117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:10.673716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8c5fa-bd3a-4df3-89ca-8ec2eb9417a4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:10.711713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84062f0-9945-4da9-9317-281635d809c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:10.712398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84062f0-9945-4da9-9317-281635d809c1 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:10.712610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84062f0-9945-4da9-9317-281635d809c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:10.712961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84062f0-9945-4da9-9317-281635d809c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:10.724329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84062f0-9945-4da9-9317-281635d809c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:10.725951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84062f0-9945-4da9-9317-281635d809c1 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-a84062f0-9945-4da9-9317-281635d809c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:10.742412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:10.743580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:10.744645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:10.744645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:10.744645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:10.744645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 637/1251] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:10.749496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2890015-6d6a-4564-90c6-9d16a56280ad None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:10.863541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2890015-6d6a-4564-90c6-9d16a56280ad None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:10.903056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f813-0205-44f5-9599-782e38226152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:10.903673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f813-0205-44f5-9599-782e38226152 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:10.903952 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f813-0205-44f5-9599-782e38226152 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:10.904227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f813-0205-44f5-9599-782e38226152 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:10.905405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9f813-0205-44f5-9599-782e38226152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:10.905713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9f813-0205-44f5-9599-782e38226152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:10.907123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9f813-0205-44f5-9599-782e38226152 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:10.921494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 615/1252] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:10.928433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84062f0-9945-4da9-9317-281635d809c1 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:11.038352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84062f0-9945-4da9-9317-281635d809c1 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:11.078043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:11.090860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af567f6-50e6-4e13-bebe-2a66c3108435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:11.091642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af567f6-50e6-4e13-bebe-2a66c3108435 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:11.091964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af567f6-50e6-4e13-bebe-2a66c3108435 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:11.092308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af567f6-50e6-4e13-bebe-2a66c3108435 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:11.105947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af567f6-50e6-4e13-bebe-2a66c3108435 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:11.107581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af567f6-50e6-4e13-bebe-2a66c3108435 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-5af567f6-50e6-4e13-bebe-2a66c3108435 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:11.119735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:11.120791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:11.121737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 638/1253] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:30:11.127744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f813-0205-44f5-9599-782e38226152 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:11.199590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:11.261017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f813-0205-44f5-9599-782e38226152 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:11.303179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ffe2b-3dc8-4b7a-91ef-6df339148227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:11.303714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffe2b-3dc8-4b7a-91ef-6df339148227 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:11.303991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffe2b-3dc8-4b7a-91ef-6df339148227 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:11.304304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ffe2b-3dc8-4b7a-91ef-6df339148227 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:11.304989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffe2b-3dc8-4b7a-91ef-6df339148227 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:11.305291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffe2b-3dc8-4b7a-91ef-6df339148227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:11.306745 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ffe2b-3dc8-4b7a-91ef-6df339148227 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:11.327782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 616/1254] 10.222.0.89 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:11.333740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af567f6-50e6-4e13-bebe-2a66c3108435 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:11.457437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af567f6-50e6-4e13-bebe-2a66c3108435 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:11.491731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaba5a3-08c5-4fb8-acc0-edb3be9eea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:11.492445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaba5a3-08c5-4fb8-acc0-edb3be9eea7d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:11.492730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaba5a3-08c5-4fb8-acc0-edb3be9eea7d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:11.493033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaba5a3-08c5-4fb8-acc0-edb3be9eea7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:11.556204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:11.570411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaba5a3-08c5-4fb8-acc0-edb3be9eea7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:11.572035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaba5a3-08c5-4fb8-acc0-edb3be9eea7d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:11.712382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 639/1255] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:30:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:30:11.718499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ffe2b-3dc8-4b7a-91ef-6df339148227 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:11.840029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ffe2b-3dc8-4b7a-91ef-6df339148227 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:11.853734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:11.880278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7884f64-abbc-42cf-8713-528197b5ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:11.881037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7884f64-abbc-42cf-8713-528197b5ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:11.881431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7884f64-abbc-42cf-8713-528197b5ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:11.881833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7884f64-abbc-42cf-8713-528197b5ffb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:11.894194 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7884f64-abbc-42cf-8713-528197b5ffb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:11.895807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7884f64-abbc-42cf-8713-528197b5ffb6 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-d7884f64-abbc-42cf-8713-528197b5ffb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:11.913235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:11.914388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:11.916043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:11.916043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:11.916043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:11.916043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 617/1256] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:11.921800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaba5a3-08c5-4fb8-acc0-edb3be9eea7d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.057697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:12.072139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaba5a3-08c5-4fb8-acc0-edb3be9eea7d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:12.108573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b4505-dd18-4afd-805a-7c4286b776ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:12.109103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b4505-dd18-4afd-805a-7c4286b776ba None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:12.109379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b4505-dd18-4afd-805a-7c4286b776ba None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:12.109650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b4505-dd18-4afd-805a-7c4286b776ba None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:12.110286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b4505-dd18-4afd-805a-7c4286b776ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:12.113208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b4505-dd18-4afd-805a-7c4286b776ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:12.113208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b4505-dd18-4afd-805a-7c4286b776ba None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:12.126080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 640/1257] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:12.133190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7884f64-abbc-42cf-8713-528197b5ffb6 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.252088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7884f64-abbc-42cf-8713-528197b5ffb6 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:12.301693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c435e8e-694d-4e1e-8666-e78b21b23ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:12.302730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c435e8e-694d-4e1e-8666-e78b21b23ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:12.303200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c435e8e-694d-4e1e-8666-e78b21b23ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:12.303680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c435e8e-694d-4e1e-8666-e78b21b23ca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:12.314080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c435e8e-694d-4e1e-8666-e78b21b23ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:12.315709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c435e8e-694d-4e1e-8666-e78b21b23ca9 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-9c435e8e-694d-4e1e-8666-e78b21b23ca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:12.329404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:12.331425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:12.333377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:12.333377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:12.333377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:12.333377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:12.333377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:12.333377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:12.333377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:12.333377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:12.333377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 618/1258] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:12.337031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b4505-dd18-4afd-805a-7c4286b776ba None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.463905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b4505-dd18-4afd-805a-7c4286b776ba None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:12.506726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025aa76-627a-4162-93e0-bebc2655b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:12.507412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025aa76-627a-4162-93e0-bebc2655b10d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:12.507694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025aa76-627a-4162-93e0-bebc2655b10d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:12.507976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025aa76-627a-4162-93e0-bebc2655b10d None admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:12.508713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025aa76-627a-4162-93e0-bebc2655b10d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:12.509021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025aa76-627a-4162-93e0-bebc2655b10d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:12.510524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025aa76-627a-4162-93e0-bebc2655b10d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:12.524908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 641/1259] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:12.532039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c435e8e-694d-4e1e-8666-e78b21b23ca9 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:12.572832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:12.656102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c435e8e-694d-4e1e-8666-e78b21b23ca9 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:12.691880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefea10d-95f6-47f4-b64b-ed52b4cb7acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:12.692484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefea10d-95f6-47f4-b64b-ed52b4cb7acc None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:12.692768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefea10d-95f6-47f4-b64b-ed52b4cb7acc None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:12.693044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefea10d-95f6-47f4-b64b-ed52b4cb7acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:12.693794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefea10d-95f6-47f4-b64b-ed52b4cb7acc None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=8d086e815c1542d1ba9daf81e644166a) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:12.694109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefea10d-95f6-47f4-b64b-ed52b4cb7acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:12.695616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefea10d-95f6-47f4-b64b-ed52b4cb7acc None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:12.702294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 619/1260] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:30:12 2022] GET /identity/v3/role_assignments?user.id=8d086e815c1542d1ba9daf81e644166a&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=609b1a993a394f0e900e17edccebaea5 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:14.618280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b275f-09ab-4392-84c7-d892d3d248ac None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:14.618968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b275f-09ab-4392-84c7-d892d3d248ac None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:14.618968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b275f-09ab-4392-84c7-d892d3d248ac None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:14.620193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 642/1261] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:14.625963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a2f1-3250-4901-898a-fef5299eb2ce None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:14.626376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a2f1-3250-4901-898a-fef5299eb2ce None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:14.626512 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a2f1-3250-4901-898a-fef5299eb2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:14.645125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c6c9a2f1-3250-4901-898a-fef5299eb2ce None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:14.646313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c6c9a2f1-3250-4901-898a-fef5299eb2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:14.710831 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 620/1262] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:14.978426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b275f-09ab-4392-84c7-d892d3d248ac None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:14.989660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:15.079105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b275f-09ab-4392-84c7-d892d3d248ac None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:15.112127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82eb1-5f97-4120-a044-707ec6c5a498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:15.112751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82eb1-5f97-4120-a044-707ec6c5a498 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:15.113028 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82eb1-5f97-4120-a044-707ec6c5a498 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:15.113297 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82eb1-5f97-4120-a044-707ec6c5a498 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:15.123852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb82eb1-5f97-4120-a044-707ec6c5a498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-cbb82eb1-5f97-4120-a044-707ec6c5a498 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:15.128484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:15.129887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:15.130873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 643/1263] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:30:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:15.135743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9a2f1-3250-4901-898a-fef5299eb2ce None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:15.155400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:15.245322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9a2f1-3250-4901-898a-fef5299eb2ce None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:15.278619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa016a-2351-4127-a8fa-4b1da5c77fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:15.279247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa016a-2351-4127-a8fa-4b1da5c77fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:15.279554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa016a-2351-4127-a8fa-4b1da5c77fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:15.279825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa016a-2351-4127-a8fa-4b1da5c77fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:15.280486 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa016a-2351-4127-a8fa-4b1da5c77fe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:15.280790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa016a-2351-4127-a8fa-4b1da5c77fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:15.282157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa016a-2351-4127-a8fa-4b1da5c77fe7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:15.290007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 621/1264] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:30:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:15.296379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82eb1-5f97-4120-a044-707ec6c5a498 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:15.366305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:15.399598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82eb1-5f97-4120-a044-707ec6c5a498 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:15.432069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1896-52b8-4ede-8824-92b4ed083c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:15.432686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1896-52b8-4ede-8824-92b4ed083c9d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:15.432962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1896-52b8-4ede-8824-92b4ed083c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:15.433235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1896-52b8-4ede-8824-92b4ed083c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:15.443327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f1896-52b8-4ede-8824-92b4ed083c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:15.444754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f1896-52b8-4ede-8824-92b4ed083c9d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-be7f1896-52b8-4ede-8824-92b4ed083c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:15.458168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:15.459288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:15.460260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:15.460260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:15.460260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:15.460260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 644/1265] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:15.465627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa016a-2351-4127-a8fa-4b1da5c77fe7 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:15.549248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:15.568622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa016a-2351-4127-a8fa-4b1da5c77fe7 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:15.603335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed66120-a10f-437b-9cd3-924be8388b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:15.603935 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed66120-a10f-437b-9cd3-924be8388b5e None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:15.604214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed66120-a10f-437b-9cd3-924be8388b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:15.604486 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed66120-a10f-437b-9cd3-924be8388b5e None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:15.605122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed66120-a10f-437b-9cd3-924be8388b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:15.605426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed66120-a10f-437b-9cd3-924be8388b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:15.606811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed66120-a10f-437b-9cd3-924be8388b5e None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:15.618765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 622/1266] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:15.624922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1896-52b8-4ede-8824-92b4ed083c9d None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:15.725179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1896-52b8-4ede-8824-92b4ed083c9d None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:15.744352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:15.758005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097a05-04a0-4529-a5db-867c1dd00cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:15.758623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097a05-04a0-4529-a5db-867c1dd00cdd None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:15.758897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097a05-04a0-4529-a5db-867c1dd00cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:15.759206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097a05-04a0-4529-a5db-867c1dd00cdd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:15.767075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b097a05-04a0-4529-a5db-867c1dd00cdd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:15.768501 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b097a05-04a0-4529-a5db-867c1dd00cdd None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-8b097a05-04a0-4529-a5db-867c1dd00cdd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:15.779109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:15.780684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:15.781628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:15.783085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 645/1267] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:15.786413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed66120-a10f-437b-9cd3-924be8388b5e None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:15.883218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed66120-a10f-437b-9cd3-924be8388b5e None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:15.915698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4f14b-0c95-4a62-bf11-198bbabe2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:15.916290 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4f14b-0c95-4a62-bf11-198bbabe2210 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:15.916566 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4f14b-0c95-4a62-bf11-198bbabe2210 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:15.916834 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4f14b-0c95-4a62-bf11-198bbabe2210 None admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:15.917546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4f14b-0c95-4a62-bf11-198bbabe2210 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:15.917846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4f14b-0c95-4a62-bf11-198bbabe2210 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:15.919281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4f14b-0c95-4a62-bf11-198bbabe2210 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:15.928300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:15.938407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 623/1268] 10.222.0.89 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:15.944036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097a05-04a0-4529-a5db-867c1dd00cdd None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:16.040429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097a05-04a0-4529-a5db-867c1dd00cdd None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:16.072465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7da60-88ef-4340-a779-64b3f0cf219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:16.073118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7da60-88ef-4340-a779-64b3f0cf219b None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.073351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7da60-88ef-4340-a779-64b3f0cf219b None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.073624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7da60-88ef-4340-a779-64b3f0cf219b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.083877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7da60-88ef-4340-a779-64b3f0cf219b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:16.085300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7da60-88ef-4340-a779-64b3f0cf219b None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-1dd7da60-88ef-4340-a779-64b3f0cf219b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:16.099388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:16.100334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:16.101285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:16.101285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:16.101285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:16.101285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 646/1269] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:16.107063 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4f14b-0c95-4a62-bf11-198bbabe2210 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:16.207380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4f14b-0c95-4a62-bf11-198bbabe2210 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:16.240578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815bd90-2886-4572-9e42-1120e439a721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:16.241168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815bd90-2886-4572-9e42-1120e439a721 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.241446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815bd90-2886-4572-9e42-1120e439a721 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.241714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815bd90-2886-4572-9e42-1120e439a721 None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.242345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815bd90-2886-4572-9e42-1120e439a721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:16.242641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815bd90-2886-4572-9e42-1120e439a721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:16.244023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815bd90-2886-4572-9e42-1120e439a721 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:16.254849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 624/1270] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:16.260717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7da60-88ef-4340-a779-64b3f0cf219b None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:16.292202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:16.362813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7da60-88ef-4340-a779-64b3f0cf219b None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:16.395192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73d955-1147-49b1-9a96-f1329d5aaf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:16.395812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73d955-1147-49b1-9a96-f1329d5aaf68 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.396090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73d955-1147-49b1-9a96-f1329d5aaf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.396362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73d955-1147-49b1-9a96-f1329d5aaf68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.402827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73d955-1147-49b1-9a96-f1329d5aaf68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:16.404806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73d955-1147-49b1-9a96-f1329d5aaf68 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-4c73d955-1147-49b1-9a96-f1329d5aaf68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:16.416019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:16.417180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:16.418578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:16.418578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:16.418578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:16.418578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:16.418578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:16.418578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:16.418578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:16.418578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:16.418578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 647/1271] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:16.423571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815bd90-2886-4572-9e42-1120e439a721 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:16.483436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:16.530670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815bd90-2886-4572-9e42-1120e439a721 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:16.563424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba380a-f507-4d46-b391-83f3ca069046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:16.564030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba380a-f507-4d46-b391-83f3ca069046 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.564312 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba380a-f507-4d46-b391-83f3ca069046 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.564584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba380a-f507-4d46-b391-83f3ca069046 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.565314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba380a-f507-4d46-b391-83f3ca069046 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:16.565576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba380a-f507-4d46-b391-83f3ca069046 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:16.567025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba380a-f507-4d46-b391-83f3ca069046 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:16.579197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 625/1272] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:16.585259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73d955-1147-49b1-9a96-f1329d5aaf68 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:16.680799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:16.689732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73d955-1147-49b1-9a96-f1329d5aaf68 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:16.723048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ffe96-bd26-466f-a616-b87f97cd9941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:16.723695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ffe96-bd26-466f-a616-b87f97cd9941 None admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:16.723974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ffe96-bd26-466f-a616-b87f97cd9941 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:16.724248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ffe96-bd26-466f-a616-b87f97cd9941 None admin] PATH_INFO: `/v3/projects/57ff5577f8714f15af43ae67819220b2/users/8d086e815c1542d1ba9daf81e644166a/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:16.726115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ffe96-bd26-466f-a616-b87f97cd9941 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ff5577f8714f15af43ae67819220b2, user_id=8d086e815c1542d1ba9daf81e644166a, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:16.727566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ffe96-bd26-466f-a616-b87f97cd9941 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:16.741370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 648/1273] 10.222.0.89 () {58 vars in 1439 bytes} [Fri Aug 26 15:30:16 2022] PUT /identity/v3/projects/57ff5577f8714f15af43ae67819220b2/users/8d086e815c1542d1ba9daf81e644166a/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:30:18.652747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1b0d1-27ef-4a43-8bcb-aa4a600eed59 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:18.653378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1b0d1-27ef-4a43-8bcb-aa4a600eed59 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:18.653378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1b0d1-27ef-4a43-8bcb-aa4a600eed59 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:18.655197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 626/1274] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:18.660385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114294-7858-4e48-8406-5d46ab01ee13 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:18.660810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114294-7858-4e48-8406-5d46ab01ee13 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:18.660934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3114294-7858-4e48-8406-5d46ab01ee13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:18.679346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d3114294-7858-4e48-8406-5d46ab01ee13 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:18.680531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d3114294-7858-4e48-8406-5d46ab01ee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:18.750457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 649/1275] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:19.019726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1b0d1-27ef-4a43-8bcb-aa4a600eed59 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:19.121427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1b0d1-27ef-4a43-8bcb-aa4a600eed59 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:19.146452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:19.172425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43884b-2f6e-4719-a9d7-8dc051724caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:19.173296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43884b-2f6e-4719-a9d7-8dc051724caf None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:19.173661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43884b-2f6e-4719-a9d7-8dc051724caf None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:19.174030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43884b-2f6e-4719-a9d7-8dc051724caf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:19.187231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43884b-2f6e-4719-a9d7-8dc051724caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-0d43884b-2f6e-4719-a9d7-8dc051724caf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 15:30:19.193967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:19.195164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:19.196057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 627/1276] 10.222.0.89 () {56 vars in 1096 bytes} [Fri Aug 26 15:30:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:19.201524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3114294-7858-4e48-8406-5d46ab01ee13 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:19.281008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:19.299824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3114294-7858-4e48-8406-5d46ab01ee13 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:19.333974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc35048-3bfe-44c0-b5a1-6f21332338c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:19.334724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc35048-3bfe-44c0-b5a1-6f21332338c4 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:19.335082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc35048-3bfe-44c0-b5a1-6f21332338c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:19.335410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc35048-3bfe-44c0-b5a1-6f21332338c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:19.336179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc35048-3bfe-44c0-b5a1-6f21332338c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:19.336541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc35048-3bfe-44c0-b5a1-6f21332338c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:19.338207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc35048-3bfe-44c0-b5a1-6f21332338c4 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:19.348237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 650/1277] 10.222.0.89 () {56 vars in 1099 bytes} [Fri Aug 26 15:30:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:19.354701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43884b-2f6e-4719-a9d7-8dc051724caf None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:19.454205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43884b-2f6e-4719-a9d7-8dc051724caf None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:19.487710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638d4cf-e019-4d52-84f0-c87132d4b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:19.488330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638d4cf-e019-4d52-84f0-c87132d4b15a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:19.488607 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638d4cf-e019-4d52-84f0-c87132d4b15a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:19.488877 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638d4cf-e019-4d52-84f0-c87132d4b15a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:19.498567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638d4cf-e019-4d52-84f0-c87132d4b15a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:19.500028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638d4cf-e019-4d52-84f0-c87132d4b15a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-d638d4cf-e019-4d52-84f0-c87132d4b15a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:19.514398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:19.515557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:19.516727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:19.516727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:19.516727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:19.516727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 628/1278] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:19.521751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc35048-3bfe-44c0-b5a1-6f21332338c4 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:19.624006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc35048-3bfe-44c0-b5a1-6f21332338c4 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:19.666880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a70d7-f3f2-41d6-ad48-5aff2744fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:19.667571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a70d7-f3f2-41d6-ad48-5aff2744fa3c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:19.667782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a70d7-f3f2-41d6-ad48-5aff2744fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:19.668054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a70d7-f3f2-41d6-ad48-5aff2744fa3c None admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:19.668699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a70d7-f3f2-41d6-ad48-5aff2744fa3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:19.668999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a70d7-f3f2-41d6-ad48-5aff2744fa3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:19.670357 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a70d7-f3f2-41d6-ad48-5aff2744fa3c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:19.681910 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 651/1279] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:19.687627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638d4cf-e019-4d52-84f0-c87132d4b15a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:19.718494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:19.792101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638d4cf-e019-4d52-84f0-c87132d4b15a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:19.827547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e1f4a-2b44-4c96-bde6-558533b999d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:19.828178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e1f4a-2b44-4c96-bde6-558533b999d8 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:19.828456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e1f4a-2b44-4c96-bde6-558533b999d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:19.828727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e1f4a-2b44-4c96-bde6-558533b999d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:19.835986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e1f4a-2b44-4c96-bde6-558533b999d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:19.837411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e1f4a-2b44-4c96-bde6-558533b999d8 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-e27e1f4a-2b44-4c96-bde6-558533b999d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 15:30:19.848272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:19.849397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 15:30:19.850665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:19.854071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 629/1280] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:19.855261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a70d7-f3f2-41d6-ad48-5aff2744fa3c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:19.859125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:19.953392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a70d7-f3f2-41d6-ad48-5aff2744fa3c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:19.986027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf49473-3f08-45ad-8c37-178dfac65767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:19.986737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf49473-3f08-45ad-8c37-178dfac65767 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:19.987044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf49473-3f08-45ad-8c37-178dfac65767 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:19.987314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf49473-3f08-45ad-8c37-178dfac65767 None admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:19.988033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf49473-3f08-45ad-8c37-178dfac65767 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:19.988332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf49473-3f08-45ad-8c37-178dfac65767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:19.989740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf49473-3f08-45ad-8c37-178dfac65767 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:20.007726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 652/1281] 10.222.0.89 () {56 vars in 1143 bytes} [Fri Aug 26 15:30:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:20.013549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e1f4a-2b44-4c96-bde6-558533b999d8 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:20.101789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:20.112010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e1f4a-2b44-4c96-bde6-558533b999d8 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:20.149054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22fd9d-9259-4afe-9da6-1e3934fcdf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:20.149659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22fd9d-9259-4afe-9da6-1e3934fcdf04 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.149962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22fd9d-9259-4afe-9da6-1e3934fcdf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.150232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22fd9d-9259-4afe-9da6-1e3934fcdf04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.215226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22fd9d-9259-4afe-9da6-1e3934fcdf04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:20.216594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22fd9d-9259-4afe-9da6-1e3934fcdf04 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:20.313234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:20.324347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 630/1282] 10.222.0.89 () {58 vars in 1282 bytes} [Fri Aug 26 15:30:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 15:30:20.330278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf49473-3f08-45ad-8c37-178dfac65767 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:20.392652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:20.432477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf49473-3f08-45ad-8c37-178dfac65767 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:20.466303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af3cf-d1c7-43ee-93c4-cf1cd8ca016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:20.466852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af3cf-d1c7-43ee-93c4-cf1cd8ca016a None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.467181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af3cf-d1c7-43ee-93c4-cf1cd8ca016a None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.467455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af3cf-d1c7-43ee-93c4-cf1cd8ca016a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.477189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59af3cf-d1c7-43ee-93c4-cf1cd8ca016a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:20.478618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59af3cf-d1c7-43ee-93c4-cf1cd8ca016a None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-e59af3cf-d1c7-43ee-93c4-cf1cd8ca016a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 15:30:20.494962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:20.501143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 15:30:20.502158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 15:30:20.502158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 15:30:20.502158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:20.502158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 653/1283] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 15:30:20.502519 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22fd9d-9259-4afe-9da6-1e3934fcdf04 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:20.622014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22fd9d-9259-4afe-9da6-1e3934fcdf04 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:20.658536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ad77-8cd2-4299-aec2-7a0dc8c5e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:20.659228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ad77-8cd2-4299-aec2-7a0dc8c5e11a None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.659518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ad77-8cd2-4299-aec2-7a0dc8c5e11a None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.659818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ad77-8cd2-4299-aec2-7a0dc8c5e11a None admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.660500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675ad77-8cd2-4299-aec2-7a0dc8c5e11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:20.660846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675ad77-8cd2-4299-aec2-7a0dc8c5e11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:20.662315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675ad77-8cd2-4299-aec2-7a0dc8c5e11a None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:20.674439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 631/1284] 10.222.0.89 () {56 vars in 1109 bytes} [Fri Aug 26 15:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:20.680291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af3cf-d1c7-43ee-93c4-cf1cd8ca016a None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:20.785549 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af3cf-d1c7-43ee-93c4-cf1cd8ca016a None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:20.801450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:20.829988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59421ba4-d82d-4b9c-8d15-601cd207425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:20.830665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59421ba4-d82d-4b9c-8d15-601cd207425c None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.831145 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59421ba4-d82d-4b9c-8d15-601cd207425c None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.831469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59421ba4-d82d-4b9c-8d15-601cd207425c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.839791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59421ba4-d82d-4b9c-8d15-601cd207425c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:20.841646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59421ba4-d82d-4b9c-8d15-601cd207425c None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application [None req-59421ba4-d82d-4b9c-8d15-601cd207425c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 15:30:20.853224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:20.854709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:20.855887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 15:30:20.855887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 15:30:20.855887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 15:30:20.855887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 15:30:20.855887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 15:30:20.855887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 15:30:20.855887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 15:30:20.855887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: ERROR keystone.server.flask.application Aug 26 15:30:20.855887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 654/1285] 10.222.0.89 () {56 vars in 1111 bytes} [Fri Aug 26 15:30:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:20.860959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ad77-8cd2-4299-aec2-7a0dc8c5e11a None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:20.910115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:20.960024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ad77-8cd2-4299-aec2-7a0dc8c5e11a None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:20.992734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920374b7-3a6c-4e23-8e7a-e90680e1cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:20.993331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920374b7-3a6c-4e23-8e7a-e90680e1cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:20.993616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920374b7-3a6c-4e23-8e7a-e90680e1cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:20.993881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920374b7-3a6c-4e23-8e7a-e90680e1cbe7 None admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:20.994575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920374b7-3a6c-4e23-8e7a-e90680e1cbe7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:20.994879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920374b7-3a6c-4e23-8e7a-e90680e1cbe7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:20.996328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920374b7-3a6c-4e23-8e7a-e90680e1cbe7 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:21.008009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 632/1286] 10.222.0.89 () {56 vars in 1148 bytes} [Fri Aug 26 15:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:21.015002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59421ba4-d82d-4b9c-8d15-601cd207425c None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:21.112956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59421ba4-d82d-4b9c-8d15-601cd207425c None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:21.150050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5b8f6-7d19-4eca-b57d-7c09c15b1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:21.150712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b8f6-7d19-4eca-b57d-7c09c15b1fda None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:21.151089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b8f6-7d19-4eca-b57d-7c09c15b1fda None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:21.151369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b8f6-7d19-4eca-b57d-7c09c15b1fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:21.152090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5b8f6-7d19-4eca-b57d-7c09c15b1fda None admin] RBAC: Adding query filter params (role.id=609b1a993a394f0e900e17edccebaea5, scope.project.id=57ff5577f8714f15af43ae67819220b2, user.id=8d086e815c1542d1ba9daf81e644166a) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:21.152401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5b8f6-7d19-4eca-b57d-7c09c15b1fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:21.153825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5b8f6-7d19-4eca-b57d-7c09c15b1fda None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:21.160123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 655/1287] 10.222.0.89 () {56 vars in 1374 bytes} [Fri Aug 26 15:30:21 2022] GET /identity/v3/role_assignments?user.id=8d086e815c1542d1ba9daf81e644166a&scope.project.id=57ff5577f8714f15af43ae67819220b2&role.id=609b1a993a394f0e900e17edccebaea5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:23.103368 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb0356-fc1c-45b9-8469-1d856380223b None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:23.103882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb0356-fc1c-45b9-8469-1d856380223b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:23.103882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb0356-fc1c-45b9-8469-1d856380223b None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:23.105440 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 633/1288] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:23.111203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a218-b485-4160-be22-f9a68c8cd2f2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:23.111934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a218-b485-4160-be22-f9a68c8cd2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:23.111934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a218-b485-4160-be22-f9a68c8cd2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:23.130787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6021a218-b485-4160-be22-f9a68c8cd2f2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:23.132308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6021a218-b485-4160-be22-f9a68c8cd2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:23.172259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:23.219249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 656/1289] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:30:23.489734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb0356-fc1c-45b9-8469-1d856380223b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:23.603199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb0356-fc1c-45b9-8469-1d856380223b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:23.615426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:23.643639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b5720-621e-49ef-87ba-07d44c0ffe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:23.644388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b5720-621e-49ef-87ba-07d44c0ffe71 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:23.644728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b5720-621e-49ef-87ba-07d44c0ffe71 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:23.645065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b5720-621e-49ef-87ba-07d44c0ffe71 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:23.645774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b5720-621e-49ef-87ba-07d44c0ffe71 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:23.647455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b5720-621e-49ef-87ba-07d44c0ffe71 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-1a2b5720-621e-49ef-87ba-07d44c0ffe71 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:23.657508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:23.659517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:23.661513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 634/1290] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:30:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:23.667230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a218-b485-4160-be22-f9a68c8cd2f2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:23.793453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a218-b485-4160-be22-f9a68c8cd2f2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:23.832078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9805e1-9118-47d3-b2b7-beb0d2d7f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:23.832693 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9805e1-9118-47d3-b2b7-beb0d2d7f14d None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:23.832971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9805e1-9118-47d3-b2b7-beb0d2d7f14d None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:23.833245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9805e1-9118-47d3-b2b7-beb0d2d7f14d None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:23.833890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9805e1-9118-47d3-b2b7-beb0d2d7f14d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:23.834204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9805e1-9118-47d3-b2b7-beb0d2d7f14d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:23.835615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9805e1-9118-47d3-b2b7-beb0d2d7f14d None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:23.840722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 657/1291] 10.222.0.89 () {56 vars in 1116 bytes} [Fri Aug 26 15:30:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:23.848644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b5720-621e-49ef-87ba-07d44c0ffe71 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:23.963528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b5720-621e-49ef-87ba-07d44c0ffe71 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:24.002274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d044cc-9e25-4dc8-b777-0c0284c9a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:24.002888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d044cc-9e25-4dc8-b777-0c0284c9a573 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:24.003200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d044cc-9e25-4dc8-b777-0c0284c9a573 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:24.003473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d044cc-9e25-4dc8-b777-0c0284c9a573 None admin] PATH_INFO: `/v3/services` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:24.004109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d044cc-9e25-4dc8-b777-0c0284c9a573 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:24.004410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d044cc-9e25-4dc8-b777-0c0284c9a573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:24.005866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d044cc-9e25-4dc8-b777-0c0284c9a573 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:24.010417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 635/1292] 10.222.0.89 () {56 vars in 1116 bytes} [Fri Aug 26 15:30:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:30:25.941286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a7d55-4a27-4288-87c7-83711e135088 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:25.942134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a7d55-4a27-4288-87c7-83711e135088 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:25.942134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a7d55-4a27-4288-87c7-83711e135088 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:25.943223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 658/1293] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:25.948629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ee022-ef36-46ec-8772-86d1172bf462 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:25.949055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ee022-ef36-46ec-8772-86d1172bf462 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:25.949190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ee022-ef36-46ec-8772-86d1172bf462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:25.967785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-a97ee022-ef36-46ec-8772-86d1172bf462 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:25.968971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a97ee022-ef36-46ec-8772-86d1172bf462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:25.997952 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:26.037446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 636/1294] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 15:30:26.305605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a7d55-4a27-4288-87c7-83711e135088 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:26.338543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:26.413698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a7d55-4a27-4288-87c7-83711e135088 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:26.446619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecd5d8-1b2e-45ef-86ea-b16296fdde8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:26.447254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecd5d8-1b2e-45ef-86ea-b16296fdde8e None admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:26.447532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecd5d8-1b2e-45ef-86ea-b16296fdde8e None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:26.447803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecd5d8-1b2e-45ef-86ea-b16296fdde8e None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:26.448454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecd5d8-1b2e-45ef-86ea-b16296fdde8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:26.449816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecd5d8-1b2e-45ef-86ea-b16296fdde8e None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:26.464853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 659/1295] 10.222.0.89 () {60 vars in 1141 bytes} [Fri Aug 26 15:30:26 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:30:28.469805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecc6f7-dcab-4e17-a1d6-8a38e9f81384 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:28.470435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecc6f7-dcab-4e17-a1d6-8a38e9f81384 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:28.470435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecc6f7-dcab-4e17-a1d6-8a38e9f81384 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:28.471736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 637/1296] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:28.476864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94180818-7a0b-418c-b3c5-c0917912d2c4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:28.477260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94180818-7a0b-418c-b3c5-c0917912d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:28.477412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94180818-7a0b-418c-b3c5-c0917912d2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:28.495191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-94180818-7a0b-418c-b3c5-c0917912d2c4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:28.496384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-94180818-7a0b-418c-b3c5-c0917912d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:28.568985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 660/1297] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:28.853181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecc6f7-dcab-4e17-a1d6-8a38e9f81384 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:28.965962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecc6f7-dcab-4e17-a1d6-8a38e9f81384 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:28.999178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fb7ed-0ac5-436f-81b4-b2decee3a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:28.999802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fb7ed-0ac5-436f-81b4-b2decee3a957 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:29.000086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fb7ed-0ac5-436f-81b4-b2decee3a957 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:29.000361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fb7ed-0ac5-436f-81b4-b2decee3a957 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:29.000950 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fb7ed-0ac5-436f-81b4-b2decee3a957 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:29.002324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fb7ed-0ac5-436f-81b4-b2decee3a957 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-883fb7ed-0ac5-436f-81b4-b2decee3a957 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:29.010783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:29.015101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:29.016163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 638/1298] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:30:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:29.018967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94180818-7a0b-418c-b3c5-c0917912d2c4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:29.036799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:29.116270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94180818-7a0b-418c-b3c5-c0917912d2c4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:29.155626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad8bc-5394-421a-8a37-62d032829750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:29.156252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad8bc-5394-421a-8a37-62d032829750 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:29.156528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad8bc-5394-421a-8a37-62d032829750 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:29.156791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad8bc-5394-421a-8a37-62d032829750 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:29.157424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad8bc-5394-421a-8a37-62d032829750 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:29.157725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad8bc-5394-421a-8a37-62d032829750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:29.159111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad8bc-5394-421a-8a37-62d032829750 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:29.171141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 661/1299] 10.222.0.89 () {56 vars in 1116 bytes} [Fri Aug 26 15:30:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:29.172794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fb7ed-0ac5-436f-81b4-b2decee3a957 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:29.214879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:29.287286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fb7ed-0ac5-436f-81b4-b2decee3a957 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:29.319918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77255d59-2211-46d4-8150-3ebdc25c74de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:29.320522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255d59-2211-46d4-8150-3ebdc25c74de None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:29.320805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255d59-2211-46d4-8150-3ebdc25c74de None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:29.321078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77255d59-2211-46d4-8150-3ebdc25c74de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:29.321775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77255d59-2211-46d4-8150-3ebdc25c74de None admin] RBAC: Adding query filter params (interface=public, service_id=232cff4cb5344fb08ce2da36e972b7d8, region_id=RegionOne) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:29.322088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77255d59-2211-46d4-8150-3ebdc25c74de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:29.323491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77255d59-2211-46d4-8150-3ebdc25c74de None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:29.328853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 639/1300] 10.222.0.89 () {56 vars in 1251 bytes} [Fri Aug 26 15:30:29 2022] GET /identity/v3/endpoints?service_id=232cff4cb5344fb08ce2da36e972b7d8&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:29.334696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad8bc-5394-421a-8a37-62d032829750 None admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:29.415118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:29.433529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad8bc-5394-421a-8a37-62d032829750 None admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:29.467644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002ccaa-f8eb-4840-8fcb-8e713427c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:29.468247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002ccaa-f8eb-4840-8fcb-8e713427c8be None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:29.468531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002ccaa-f8eb-4840-8fcb-8e713427c8be None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:29.468808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002ccaa-f8eb-4840-8fcb-8e713427c8be None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:29.469413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002ccaa-f8eb-4840-8fcb-8e713427c8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:29.470783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002ccaa-f8eb-4840-8fcb-8e713427c8be None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:29.477460 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 662/1301] 10.222.0.89 () {56 vars in 1087 bytes} [Fri Aug 26 15:30:29 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:30:31.370951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad24e-f50b-4d2a-a0f3-03e93623761a None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:31.371510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad24e-f50b-4d2a-a0f3-03e93623761a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:31.371510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ad24e-f50b-4d2a-a0f3-03e93623761a None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:31.372826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 640/1302] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:30:31.378512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e6e1f-584a-4ac3-ba77-6028683fa05c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:31.378918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e6e1f-584a-4ac3-ba77-6028683fa05c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:31.379093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e6e1f-584a-4ac3-ba77-6028683fa05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:31.397770 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8d4e6e1f-584a-4ac3-ba77-6028683fa05c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:30:31.398981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8d4e6e1f-584a-4ac3-ba77-6028683fa05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:30:31.464351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 663/1303] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:30:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 15:30:31.733738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad24e-f50b-4d2a-a0f3-03e93623761a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:31.831458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:31.839747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ad24e-f50b-4d2a-a0f3-03e93623761a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:31.873232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06431ddc-cd76-4893-9490-32157ec36d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:31.873851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431ddc-cd76-4893-9490-32157ec36d48 None admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:31.874133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431ddc-cd76-4893-9490-32157ec36d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:31.874410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431ddc-cd76-4893-9490-32157ec36d48 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:31.875021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06431ddc-cd76-4893-9490-32157ec36d48 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:31.876381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06431ddc-cd76-4893-9490-32157ec36d48 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application [None req-06431ddc-cd76-4893-9490-32157ec36d48 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 15:30:31.884842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 15:30:31.885988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application with Lock( Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self._enter() Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application return self.creator() Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application created_value = creator( Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: ERROR keystone.server.flask.application Aug 26 15:30:31.886860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 641/1304] 10.222.0.89 () {56 vars in 1117 bytes} [Fri Aug 26 15:30:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 15:30:31.892251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e6e1f-584a-4ac3-ba77-6028683fa05c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:31.966705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:31.990312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e6e1f-584a-4ac3-ba77-6028683fa05c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:32.026194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c458c8-960f-437c-8b2f-6c5c20e6a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:32.026816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c458c8-960f-437c-8b2f-6c5c20e6a099 None admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:32.027125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c458c8-960f-437c-8b2f-6c5c20e6a099 None admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:32.027403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c458c8-960f-437c-8b2f-6c5c20e6a099 None admin] PATH_INFO: `/v3/services` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:32.028043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c458c8-960f-437c-8b2f-6c5c20e6a099 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:30:32.028357 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c458c8-960f-437c-8b2f-6c5c20e6a099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:32.030277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c458c8-960f-437c-8b2f-6c5c20e6a099 None admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:32.035520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 664/1305] 10.222.0.89 () {56 vars in 1116 bytes} [Fri Aug 26 15:30:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:30:32.041519 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06431ddc-cd76-4893-9490-32157ec36d48 None admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:30:32.146461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06431ddc-cd76-4893-9490-32157ec36d48 None admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:30:32.182263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747248d-8083-4e9c-8f68-cbf48361b257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:30:32.182857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747248d-8083-4e9c-8f68-cbf48361b257 None admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:30:32.183164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747248d-8083-4e9c-8f68-cbf48361b257 None admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:30:32.183434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747248d-8083-4e9c-8f68-cbf48361b257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:30:32.184081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747248d-8083-4e9c-8f68-cbf48361b257 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:30:32.185423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747248d-8083-4e9c-8f68-cbf48361b257 None admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:30:32.205451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 642/1306] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:30:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:30:42.032583 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=30 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:30:42.200648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:39.505887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c21fe-14f2-496d-a7ee-091e0e6e17c6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:39.506364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c21fe-14f2-496d-a7ee-091e0e6e17c6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:39.506446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c21fe-14f2-496d-a7ee-091e0e6e17c6 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:39.508680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 665/1307] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:39.516423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad2c76-946e-4fe6-b990-4a629ef48443 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:39.516871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad2c76-946e-4fe6-b990-4a629ef48443 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:39.516989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad2c76-946e-4fe6-b990-4a629ef48443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:39.635109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-adad2c76-946e-4fe6-b990-4a629ef48443 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:39.637462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-adad2c76-946e-4fe6-b990-4a629ef48443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:39.870189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 643/1308] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:40.182565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564dc70-4104-4ed9-983b-d20ad67e2c76 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:40.182921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564dc70-4104-4ed9-983b-d20ad67e2c76 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:40.183149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564dc70-4104-4ed9-983b-d20ad67e2c76 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:40.184627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 666/1309] 10.222.0.89 () {54 vars in 965 bytes} [Fri Aug 26 15:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:40.198647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d094-b6bf-4a3e-b3cc-d70ded60d4e6 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:40.199008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d094-b6bf-4a3e-b3cc-d70ded60d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:40.199229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d094-b6bf-4a3e-b3cc-d70ded60d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:40.305248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-0b76d094-b6bf-4a3e-b3cc-d70ded60d4e6 None None] MFA Rules not processed for user `a7a82c500de745c0b55df44b7f641706`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:40.306475 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-0b76d094-b6bf-4a3e-b3cc-d70ded60d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:40.331165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:40.399614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 644/1310] 10.222.0.89 () {58 vars in 1062 bytes} [Fri Aug 26 15:31:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:40.408726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564dc70-4104-4ed9-983b-d20ad67e2c76 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:40.410573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8564dc70-4104-4ed9-983b-d20ad67e2c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:40.538300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564dc70-4104-4ed9-983b-d20ad67e2c76 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:40.618222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ef271-6d83-430b-bc99-a2e4b382894d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:40.619137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef271-6d83-430b-bc99-a2e4b382894d service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:40.619580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef271-6d83-430b-bc99-a2e4b382894d service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:40.620068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef271-6d83-430b-bc99-a2e4b382894d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:40.621824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1e3ef271-6d83-430b-bc99-a2e4b382894d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:40.681782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:40.743140 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ef271-6d83-430b-bc99-a2e4b382894d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:40.744871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ef271-6d83-430b-bc99-a2e4b382894d service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:40.774476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 667/1311] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:43.036330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33379ba-ab99-40e7-930c-ceb22917c688 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:43.036905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33379ba-ab99-40e7-930c-ceb22917c688 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:43.037057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33379ba-ab99-40e7-930c-ceb22917c688 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:43.039086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 645/1312] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:43.045518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844ce34-4d81-4f13-a4ce-7630d1fe5058 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:43.046082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844ce34-4d81-4f13-a4ce-7630d1fe5058 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:43.046392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844ce34-4d81-4f13-a4ce-7630d1fe5058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:43.130121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1844ce34-4d81-4f13-a4ce-7630d1fe5058 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:43.131432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1844ce34-4d81-4f13-a4ce-7630d1fe5058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:43.231507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 668/1313] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:43.513348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33379ba-ab99-40e7-930c-ceb22917c688 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:43.514877 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d33379ba-ab99-40e7-930c-ceb22917c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:43.621458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33379ba-ab99-40e7-930c-ceb22917c688 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:43.694154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:43.696528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04205efc-3f40-4c76-8a30-02aae0cb56dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:43.697227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205efc-3f40-4c76-8a30-02aae0cb56dc service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:43.697694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205efc-3f40-4c76-8a30-02aae0cb56dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:43.698011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205efc-3f40-4c76-8a30-02aae0cb56dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:43.700055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-04205efc-3f40-4c76-8a30-02aae0cb56dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:43.812145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04205efc-3f40-4c76-8a30-02aae0cb56dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:43.813664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04205efc-3f40-4c76-8a30-02aae0cb56dc service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:43.834171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 646/1314] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:46.067867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049fdd0-61c0-4916-97db-d0a88fcee7ca None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:46.068386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049fdd0-61c0-4916-97db-d0a88fcee7ca None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:46.068386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049fdd0-61c0-4916-97db-d0a88fcee7ca None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:46.069653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 669/1315] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:46.075043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845caf9-5c9f-42a6-b4e0-027cf1f94a40 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:46.075461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845caf9-5c9f-42a6-b4e0-027cf1f94a40 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:46.075581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845caf9-5c9f-42a6-b4e0-027cf1f94a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:46.147772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-6845caf9-5c9f-42a6-b4e0-027cf1f94a40 None None] MFA Rules not processed for user `e0dfd0276ce04a8eb3f53b9cf0099b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:46.148971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6845caf9-5c9f-42a6-b4e0-027cf1f94a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:46.199124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:46.242628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 647/1316] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:46.530734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049fdd0-61c0-4916-97db-d0a88fcee7ca None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:46.532901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f049fdd0-61c0-4916-97db-d0a88fcee7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:46.543047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:46.646776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049fdd0-61c0-4916-97db-d0a88fcee7ca None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:46.719086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f3fa8-5ee0-4052-a495-1bccfaa074d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:46.720266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f3fa8-5ee0-4052-a495-1bccfaa074d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:46.720548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f3fa8-5ee0-4052-a495-1bccfaa074d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:46.720818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f3fa8-5ee0-4052-a495-1bccfaa074d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:46.722420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c41f3fa8-5ee0-4052-a495-1bccfaa074d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:46.783731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:46.831413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f3fa8-5ee0-4052-a495-1bccfaa074d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:46.832865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f3fa8-5ee0-4052-a495-1bccfaa074d6 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:46.851309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 670/1317] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:49.335616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79740494-d638-4890-bf74-5ca97aaee7e3 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:49.336171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79740494-d638-4890-bf74-5ca97aaee7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:49.336171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79740494-d638-4890-bf74-5ca97aaee7e3 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:49.337484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 648/1318] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:49.342889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e9c0-8b14-4255-9b7b-a97a7bbb60a4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:49.343395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e9c0-8b14-4255-9b7b-a97a7bbb60a4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:49.343486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e9c0-8b14-4255-9b7b-a97a7bbb60a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:49.408674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7060e9c0-8b14-4255-9b7b-a97a7bbb60a4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:49.409897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7060e9c0-8b14-4255-9b7b-a97a7bbb60a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:49.505277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 671/1319] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:49.785958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79740494-d638-4890-bf74-5ca97aaee7e3 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:49.787529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-79740494-d638-4890-bf74-5ca97aaee7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:49.890320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79740494-d638-4890-bf74-5ca97aaee7e3 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:49.964277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d106158-ce09-4581-b425-a0d810fd0265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:49.964878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d106158-ce09-4581-b425-a0d810fd0265 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:49.965154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d106158-ce09-4581-b425-a0d810fd0265 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:49.965420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d106158-ce09-4581-b425-a0d810fd0265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:49.967045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4d106158-ce09-4581-b425-a0d810fd0265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:49.974546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:50.075082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d106158-ce09-4581-b425-a0d810fd0265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:50.076442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d106158-ce09-4581-b425-a0d810fd0265 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:50.095581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 649/1320] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:52.686253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819bbbe-b9d2-46aa-a24f-c22bfc405760 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:52.686857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819bbbe-b9d2-46aa-a24f-c22bfc405760 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:52.686857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819bbbe-b9d2-46aa-a24f-c22bfc405760 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:52.688180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 672/1321] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:52.693678 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac384b-556f-43a9-8519-ed282600cab6 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:52.694170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac384b-556f-43a9-8519-ed282600cab6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:52.694262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac384b-556f-43a9-8519-ed282600cab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:52.763689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-33ac384b-556f-43a9-8519-ed282600cab6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:52.764904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-33ac384b-556f-43a9-8519-ed282600cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:52.828180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:52.881683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 650/1322] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:53.165654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819bbbe-b9d2-46aa-a24f-c22bfc405760 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:53.167300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e819bbbe-b9d2-46aa-a24f-c22bfc405760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:53.187068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:53.275603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819bbbe-b9d2-46aa-a24f-c22bfc405760 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:53.348799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f094e-1f1c-4f5c-abe0-c34cd0f73a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:53.349408 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f094e-1f1c-4f5c-abe0-c34cd0f73a0b service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:53.349684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f094e-1f1c-4f5c-abe0-c34cd0f73a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:53.349953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f094e-1f1c-4f5c-abe0-c34cd0f73a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:53.351651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8e8f094e-1f1c-4f5c-abe0-c34cd0f73a0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:53.423994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:53.466826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f094e-1f1c-4f5c-abe0-c34cd0f73a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:53.468276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f094e-1f1c-4f5c-abe0-c34cd0f73a0b service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:53.486493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 673/1323] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:55.491188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a922d66-ac7d-4845-8164-4256e6c9a4e7 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:55.491699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a922d66-ac7d-4845-8164-4256e6c9a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:55.491699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a922d66-ac7d-4845-8164-4256e6c9a4e7 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:55.493077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 651/1324] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:55.498674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacff03-638d-4eec-b311-019182878e72 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:55.499232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacff03-638d-4eec-b311-019182878e72 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:55.499327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacff03-638d-4eec-b311-019182878e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:55.577099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-aeacff03-638d-4eec-b311-019182878e72 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:55.578330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aeacff03-638d-4eec-b311-019182878e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:55.695934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 674/1325] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:55.979820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a922d66-ac7d-4845-8164-4256e6c9a4e7 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:55.981359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4a922d66-ac7d-4845-8164-4256e6c9a4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:56.090782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a922d66-ac7d-4845-8164-4256e6c9a4e7 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:56.168145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd59830-cc82-429a-a099-8577536e2a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:56.168824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59830-cc82-429a-a099-8577536e2a1a service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:56.169102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59830-cc82-429a-a099-8577536e2a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:56.169373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59830-cc82-429a-a099-8577536e2a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:56.171012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8fd59830-cc82-429a-a099-8577536e2a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:56.188853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:56.294306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd59830-cc82-429a-a099-8577536e2a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:56.296302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd59830-cc82-429a-a099-8577536e2a1a service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:56.319675 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 652/1326] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:31:58.336046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b64ed-1802-4c40-9480-7de5eb1f99ec None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:58.336609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b64ed-1802-4c40-9480-7de5eb1f99ec None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:58.336609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b64ed-1802-4c40-9480-7de5eb1f99ec None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:58.338025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 675/1327] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:58.343728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820447d-d5e1-469d-bed3-7305b2c785f0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:58.344189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820447d-d5e1-469d-bed3-7305b2c785f0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:58.344407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820447d-d5e1-469d-bed3-7305b2c785f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:58.412855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5820447d-d5e1-469d-bed3-7305b2c785f0 None None] MFA Rules not processed for user `e0dfd0276ce04a8eb3f53b9cf0099b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:58.414070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5820447d-d5e1-469d-bed3-7305b2c785f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:58.480503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:58.512924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 653/1328] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:58.814263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ef96-acf1-4b0f-b3ad-e974bd0d8d2a None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:58.814608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ef96-acf1-4b0f-b3ad-e974bd0d8d2a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:58.814815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754ef96-acf1-4b0f-b3ad-e974bd0d8d2a None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:58.816281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 676/1329] 10.222.0.89 () {54 vars in 965 bytes} [Fri Aug 26 15:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:31:58.822954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed261150-8224-438b-9247-33957d02c581 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:58.823272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed261150-8224-438b-9247-33957d02c581 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:58.823556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed261150-8224-438b-9247-33957d02c581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:58.903575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ed261150-8224-438b-9247-33957d02c581 None None] MFA Rules not processed for user `a7a82c500de745c0b55df44b7f641706`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:31:58.904796 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ed261150-8224-438b-9247-33957d02c581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:58.981451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 654/1330] 10.222.0.89 () {58 vars in 1062 bytes} [Fri Aug 26 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:31:58.990725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754ef96-acf1-4b0f-b3ad-e974bd0d8d2a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:31:58.992377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c754ef96-acf1-4b0f-b3ad-e974bd0d8d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:59.024640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:59.101289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754ef96-acf1-4b0f-b3ad-e974bd0d8d2a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:31:59.174453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f01cb-8ac0-43f9-a612-b41aff282f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:31:59.175088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f01cb-8ac0-43f9-a612-b41aff282f01 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:31:59.175365 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f01cb-8ac0-43f9-a612-b41aff282f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:31:59.175631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f01cb-8ac0-43f9-a612-b41aff282f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:31:59.177252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a28f01cb-8ac0-43f9-a612-b41aff282f01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:31:59.256581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:31:59.289112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f01cb-8ac0-43f9-a612-b41aff282f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:31:59.290451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f01cb-8ac0-43f9-a612-b41aff282f01 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:31:59.309421 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 677/1331] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:31:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:01.869553 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1c025-bbd7-4b0a-88e6-4ec160d6dc89 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:01.870127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1c025-bbd7-4b0a-88e6-4ec160d6dc89 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:01.870127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1c025-bbd7-4b0a-88e6-4ec160d6dc89 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:01.871498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 655/1332] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:01.877207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910e3e-af2f-4c5e-90f2-34c392ce1720 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:01.877602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910e3e-af2f-4c5e-90f2-34c392ce1720 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:01.877792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910e3e-af2f-4c5e-90f2-34c392ce1720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:01.943659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bc910e3e-af2f-4c5e-90f2-34c392ce1720 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:01.944853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bc910e3e-af2f-4c5e-90f2-34c392ce1720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:02.037895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 678/1333] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:02.325072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1c025-bbd7-4b0a-88e6-4ec160d6dc89 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:02.326392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b4b1c025-bbd7-4b0a-88e6-4ec160d6dc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:02.395103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:02.428400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1c025-bbd7-4b0a-88e6-4ec160d6dc89 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:02.500513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261eac6-9b79-4538-8aa5-681c9a6040b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:02.501701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261eac6-9b79-4538-8aa5-681c9a6040b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:02.501984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261eac6-9b79-4538-8aa5-681c9a6040b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:02.502258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261eac6-9b79-4538-8aa5-681c9a6040b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:02.504014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1261eac6-9b79-4538-8aa5-681c9a6040b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:02.613782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261eac6-9b79-4538-8aa5-681c9a6040b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:02.615171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261eac6-9b79-4538-8aa5-681c9a6040b6 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:02.624945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:02.634876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 656/1334] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:04.575424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcb164-954a-43eb-91e2-5be1014a7d50 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:04.575990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcb164-954a-43eb-91e2-5be1014a7d50 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:04.575990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcb164-954a-43eb-91e2-5be1014a7d50 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:04.577387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 679/1335] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:04.583301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343268f7-2ed6-48cd-ba9c-5c9b2a5bc388 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:04.583706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343268f7-2ed6-48cd-ba9c-5c9b2a5bc388 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:04.583871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343268f7-2ed6-48cd-ba9c-5c9b2a5bc388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:04.647262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-343268f7-2ed6-48cd-ba9c-5c9b2a5bc388 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:04.648656 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-343268f7-2ed6-48cd-ba9c-5c9b2a5bc388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:04.740930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 657/1336] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:05.024505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcb164-954a-43eb-91e2-5be1014a7d50 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:05.026043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5efcb164-954a-43eb-91e2-5be1014a7d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:05.066161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:05.127700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcb164-954a-43eb-91e2-5be1014a7d50 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:05.200293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a1019-a1e1-4ff8-81c3-eac4b53fa7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:05.200895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1019-a1e1-4ff8-81c3-eac4b53fa7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:05.201169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1019-a1e1-4ff8-81c3-eac4b53fa7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:05.201437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1019-a1e1-4ff8-81c3-eac4b53fa7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:05.203073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-010a1019-a1e1-4ff8-81c3-eac4b53fa7f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:05.284464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:05.310441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a1019-a1e1-4ff8-81c3-eac4b53fa7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:05.311936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a1019-a1e1-4ff8-81c3-eac4b53fa7f1 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:05.330555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 680/1337] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:07.706988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fa8e0-613f-4448-aa2e-4c7cdc9278b0 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:07.707493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fa8e0-613f-4448-aa2e-4c7cdc9278b0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:07.707493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fa8e0-613f-4448-aa2e-4c7cdc9278b0 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:07.708822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 658/1338] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:07.714214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046c06-5e43-4831-b753-0c4cc87b056d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:07.714703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046c06-5e43-4831-b753-0c4cc87b056d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:07.714795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c046c06-5e43-4831-b753-0c4cc87b056d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:07.779877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9c046c06-5e43-4831-b753-0c4cc87b056d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:07.781100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9c046c06-5e43-4831-b753-0c4cc87b056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:07.877031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 681/1339] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:08.165193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fa8e0-613f-4448-aa2e-4c7cdc9278b0 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:08.166740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8c2fa8e0-613f-4448-aa2e-4c7cdc9278b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:08.241032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:08.268914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fa8e0-613f-4448-aa2e-4c7cdc9278b0 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:08.346429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbf63d-06f8-4c53-aa54-988e11c23db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:08.347064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbf63d-06f8-4c53-aa54-988e11c23db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:08.347347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbf63d-06f8-4c53-aa54-988e11c23db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:08.347619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbf63d-06f8-4c53-aa54-988e11c23db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:08.349263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6fbbf63d-06f8-4c53-aa54-988e11c23db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:08.461186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbf63d-06f8-4c53-aa54-988e11c23db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:08.462545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbf63d-06f8-4c53-aa54-988e11c23db0 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:08.482122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 659/1340] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:12.440122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aa938-e38d-4dd4-831c-199728141077 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:12.440643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aa938-e38d-4dd4-831c-199728141077 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:12.440643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aa938-e38d-4dd4-831c-199728141077 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:12.442039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 682/1341] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:12.447851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59940a16-4ccc-4c06-8d3c-96c718afe230 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:12.448307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59940a16-4ccc-4c06-8d3c-96c718afe230 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:12.448417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59940a16-4ccc-4c06-8d3c-96c718afe230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:12.453906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:12.518462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-59940a16-4ccc-4c06-8d3c-96c718afe230 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:12.519970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-59940a16-4ccc-4c06-8d3c-96c718afe230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:12.617916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 660/1342] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:12.897224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aa938-e38d-4dd4-831c-199728141077 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:12.898734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5b5aa938-e38d-4dd4-831c-199728141077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:12.947450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:13.004591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aa938-e38d-4dd4-831c-199728141077 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:13.078307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ed896-ae5a-4371-b546-834d0fe1bab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:13.078833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ed896-ae5a-4371-b546-834d0fe1bab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:13.079167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ed896-ae5a-4371-b546-834d0fe1bab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:13.079448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ed896-ae5a-4371-b546-834d0fe1bab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:13.081039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7d4ed896-ae5a-4371-b546-834d0fe1bab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:13.176014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:13.192964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ed896-ae5a-4371-b546-834d0fe1bab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:13.194386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ed896-ae5a-4371-b546-834d0fe1bab1 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:13.212133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 683/1343] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:15.764271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38a52e-a83a-4be3-a7a6-c839b73ba3ab None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:15.764794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38a52e-a83a-4be3-a7a6-c839b73ba3ab None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:15.764794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38a52e-a83a-4be3-a7a6-c839b73ba3ab None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:15.766354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 661/1344] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:15.772340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4817c-14a1-4772-b76b-0cd6d2de83e3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:15.772878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4817c-14a1-4772-b76b-0cd6d2de83e3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:15.772878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4817c-14a1-4772-b76b-0cd6d2de83e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:15.856192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a8e4817c-14a1-4772-b76b-0cd6d2de83e3 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:15.857685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a8e4817c-14a1-4772-b76b-0cd6d2de83e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:15.967213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 684/1345] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:16.261050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38a52e-a83a-4be3-a7a6-c839b73ba3ab None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:16.262842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ef38a52e-a83a-4be3-a7a6-c839b73ba3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:16.358761 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:16.378350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38a52e-a83a-4be3-a7a6-c839b73ba3ab None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:16.459015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7be7e-79bb-4368-bbab-c0530715c150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:16.459765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7be7e-79bb-4368-bbab-c0530715c150 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:16.460171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7be7e-79bb-4368-bbab-c0530715c150 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:16.460452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7be7e-79bb-4368-bbab-c0530715c150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:16.462469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bbd7be7e-79bb-4368-bbab-c0530715c150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:16.593329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7be7e-79bb-4368-bbab-c0530715c150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:16.594799 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7be7e-79bb-4368-bbab-c0530715c150 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:16.616065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 662/1346] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:21.007072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570087b-b249-4f13-a7bb-da7ca63e74dc None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:21.007632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570087b-b249-4f13-a7bb-da7ca63e74dc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:21.007632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570087b-b249-4f13-a7bb-da7ca63e74dc None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:21.008974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 685/1347] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:21.014965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcfa62-48a7-425f-ad4b-a2a26cae0929 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:21.015430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcfa62-48a7-425f-ad4b-a2a26cae0929 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:21.015544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcfa62-48a7-425f-ad4b-a2a26cae0929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:21.035868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:21.105453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-44dcfa62-48a7-425f-ad4b-a2a26cae0929 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:21.107162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-44dcfa62-48a7-425f-ad4b-a2a26cae0929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:21.226690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 663/1348] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:32:21.511035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570087b-b249-4f13-a7bb-da7ca63e74dc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:21.513213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0570087b-b249-4f13-a7bb-da7ca63e74dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:21.584165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:21.654762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570087b-b249-4f13-a7bb-da7ca63e74dc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:21.748046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a32b6-ec3c-4baf-918b-3d6aa947a115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:21.748655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a32b6-ec3c-4baf-918b-3d6aa947a115 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:21.748941 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a32b6-ec3c-4baf-918b-3d6aa947a115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:21.749317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a32b6-ec3c-4baf-918b-3d6aa947a115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:21.750897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-082a32b6-ec3c-4baf-918b-3d6aa947a115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:21.868248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:21.872280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a32b6-ec3c-4baf-918b-3d6aa947a115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:21.873994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a32b6-ec3c-4baf-918b-3d6aa947a115 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:21.894305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 686/1349] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:27.230511 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39761793-2374-4aee-a206-e5e876c6d726 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:27.231069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39761793-2374-4aee-a206-e5e876c6d726 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:27.231365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39761793-2374-4aee-a206-e5e876c6d726 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:27.233810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 664/1350] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:32:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:27.242276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913ca1-85a3-4dcb-a41e-01e3c52be9a8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:27.243641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913ca1-85a3-4dcb-a41e-01e3c52be9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:27.244243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913ca1-85a3-4dcb-a41e-01e3c52be9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:27.361112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-58913ca1-85a3-4dcb-a41e-01e3c52be9a8 None None] MFA Rules not processed for user `8d086e815c1542d1ba9daf81e644166a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:27.361536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-58913ca1-85a3-4dcb-a41e-01e3c52be9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:27.498323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 687/1351] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:31.227066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=59 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:31.762450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea2d1-7fc2-4e9c-b335-5860dbc5240d None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:31.762744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea2d1-7fc2-4e9c-b335-5860dbc5240d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:31.763058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ea2d1-7fc2-4e9c-b335-5860dbc5240d None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:31.764571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 665/1352] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:31.770407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35529-7a0c-41d9-9650-b0ecb8b2f6b4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:31.770892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35529-7a0c-41d9-9650-b0ecb8b2f6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:31.771049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb35529-7a0c-41d9-9650-b0ecb8b2f6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:31.836472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:31.861834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fbb35529-7a0c-41d9-9650-b0ecb8b2f6b4 None None] MFA Rules not processed for user `8d086e815c1542d1ba9daf81e644166a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:31.863172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fbb35529-7a0c-41d9-9650-b0ecb8b2f6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:31.986872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 688/1353] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:32:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:33.575492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b8192-710b-4034-b1ce-9ef2a941ea24 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:33.575988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b8192-710b-4034-b1ce-9ef2a941ea24 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:33.575988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b8192-710b-4034-b1ce-9ef2a941ea24 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:33.577280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 666/1354] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:33.582729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acafb1-23b6-4872-8d0c-f48c7017b2c9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:33.583232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acafb1-23b6-4872-8d0c-f48c7017b2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:33.583326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acafb1-23b6-4872-8d0c-f48c7017b2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:33.662769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b6acafb1-23b6-4872-8d0c-f48c7017b2c9 None None] MFA Rules not processed for user `8d086e815c1542d1ba9daf81e644166a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:33.664008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b6acafb1-23b6-4872-8d0c-f48c7017b2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:33.707281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:33.774671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 689/1355] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:32:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:37.123038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a023a-90a3-40b5-a644-dde9d772216f None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:37.123572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a023a-90a3-40b5-a644-dde9d772216f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:37.123572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a023a-90a3-40b5-a644-dde9d772216f None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:37.124885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 667/1356] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:37.130825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7c82-96d4-4b22-8abf-ebe5f00d3780 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:37.131269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7c82-96d4-4b22-8abf-ebe5f00d3780 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:37.131414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7c82-96d4-4b22-8abf-ebe5f00d3780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:37.212991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-933c7c82-96d4-4b22-8abf-ebe5f00d3780 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:37.214176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-933c7c82-96d4-4b22-8abf-ebe5f00d3780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:37.360725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 690/1357] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:37.667999 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4268f77-b997-405e-b0fb-27f1164bdc25 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:37.668549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4268f77-b997-405e-b0fb-27f1164bdc25 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:37.668974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4268f77-b997-405e-b0fb-27f1164bdc25 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:37.670508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 668/1358] 10.222.0.89 () {54 vars in 962 bytes} [Fri Aug 26 15:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:37.678209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01024a1-78ef-4c1b-bdb0-c1c217cfbdcf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:37.678760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01024a1-78ef-4c1b-bdb0-c1c217cfbdcf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:37.679239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01024a1-78ef-4c1b-bdb0-c1c217cfbdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:37.700624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:37.783681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c01024a1-78ef-4c1b-bdb0-c1c217cfbdcf None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:37.785089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c01024a1-78ef-4c1b-bdb0-c1c217cfbdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:37.949804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 691/1359] 10.222.0.89 () {58 vars in 1059 bytes} [Fri Aug 26 15:32:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:37.958169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4268f77-b997-405e-b0fb-27f1164bdc25 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:37.959704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b4268f77-b997-405e-b0fb-27f1164bdc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:38.118726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4268f77-b997-405e-b0fb-27f1164bdc25 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:38.199189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:38.245140 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae13a65-1817-45a7-aaae-b665de40fff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:38.245757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13a65-1817-45a7-aaae-b665de40fff0 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:38.246040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13a65-1817-45a7-aaae-b665de40fff0 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:38.246314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13a65-1817-45a7-aaae-b665de40fff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:38.247947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7ae13a65-1817-45a7-aaae-b665de40fff0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:38.340402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae13a65-1817-45a7-aaae-b665de40fff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:38.342058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae13a65-1817-45a7-aaae-b665de40fff0 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:38.361030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 669/1360] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:32:40.503511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56224-7363-486a-be1a-766888bb31c2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:40.504084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56224-7363-486a-be1a-766888bb31c2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:40.504084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c56224-7363-486a-be1a-766888bb31c2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:40.509812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 692/1361] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:40.511427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b089e6-e482-4656-9460-62c8af59e766 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:40.511915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b089e6-e482-4656-9460-62c8af59e766 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:40.512028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b089e6-e482-4656-9460-62c8af59e766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:40.585870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-27b089e6-e482-4656-9460-62c8af59e766 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:40.587188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-27b089e6-e482-4656-9460-62c8af59e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:40.630257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:40.711200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 670/1362] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:32:40.995206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c56224-7363-486a-be1a-766888bb31c2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:40.998094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-76c56224-7363-486a-be1a-766888bb31c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:41.088759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:41.193566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c56224-7363-486a-be1a-766888bb31c2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:41.315720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6aac5-6519-487a-9d60-4debf2d23cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:41.316247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6aac5-6519-487a-9d60-4debf2d23cb1 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:41.316534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6aac5-6519-487a-9d60-4debf2d23cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:41.316805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6aac5-6519-487a-9d60-4debf2d23cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:41.318467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0fa6aac5-6519-487a-9d60-4debf2d23cb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:41.350567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:41.431588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6aac5-6519-487a-9d60-4debf2d23cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:41.433449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6aac5-6519-487a-9d60-4debf2d23cb1 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:41.456098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 693/1363] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:43.715436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed83d76-1ff9-4b10-994e-80ef7c6b88de None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:43.715958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed83d76-1ff9-4b10-994e-80ef7c6b88de None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:43.715958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed83d76-1ff9-4b10-994e-80ef7c6b88de None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:43.717239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 671/1364] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:43.723138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e463-4be1-4620-82c1-741ceed20824 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:43.723615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e463-4be1-4620-82c1-741ceed20824 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:43.723705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e463-4be1-4620-82c1-741ceed20824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:43.802045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1b18e463-4be1-4620-82c1-741ceed20824 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:43.802819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1b18e463-4be1-4620-82c1-741ceed20824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:43.951540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:43.954173 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 694/1365] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:44.294915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d490bb-f559-4912-928c-1329b15ee0d9 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:44.295438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d490bb-f559-4912-928c-1329b15ee0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:44.295812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d490bb-f559-4912-928c-1329b15ee0d9 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:44.297434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 672/1366] 10.222.0.89 () {54 vars in 962 bytes} [Fri Aug 26 15:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:44.303199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d6fad-acea-414d-a953-8c58686de11e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:44.303481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d6fad-acea-414d-a953-8c58686de11e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:44.303762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d6fad-acea-414d-a953-8c58686de11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:44.395188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c83d6fad-acea-414d-a953-8c58686de11e None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:44.396405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c83d6fad-acea-414d-a953-8c58686de11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:44.536014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 695/1367] 10.222.0.89 () {58 vars in 1059 bytes} [Fri Aug 26 15:32:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:44.543855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d490bb-f559-4912-928c-1329b15ee0d9 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:44.545699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-13d490bb-f559-4912-928c-1329b15ee0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:44.735955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d490bb-f559-4912-928c-1329b15ee0d9 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:44.758034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:44.856702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86155e0b-5fd5-4def-bef2-6b7d6206ea3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:44.857310 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155e0b-5fd5-4def-bef2-6b7d6206ea3e service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:44.857588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155e0b-5fd5-4def-bef2-6b7d6206ea3e service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:44.857859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86155e0b-5fd5-4def-bef2-6b7d6206ea3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:44.859470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-86155e0b-5fd5-4def-bef2-6b7d6206ea3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:44.960566 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86155e0b-5fd5-4def-bef2-6b7d6206ea3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:44.962092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86155e0b-5fd5-4def-bef2-6b7d6206ea3e service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:44.982822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 673/1368] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:45.566394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0bc87-3658-4b1c-9dee-f0359ac2000c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:45.566957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0bc87-3658-4b1c-9dee-f0359ac2000c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:45.566957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0bc87-3658-4b1c-9dee-f0359ac2000c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:45.568467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 696/1369] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:45.573745 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a0fa-aad0-4b1a-a555-84d914325e0e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:45.574036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a0fa-aad0-4b1a-a555-84d914325e0e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:45.574306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a0fa-aad0-4b1a-a555-84d914325e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:45.608212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:45.643619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4be2a0fa-aad0-4b1a-a555-84d914325e0e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:45.645082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4be2a0fa-aad0-4b1a-a555-84d914325e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:45.749020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 674/1370] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:46.330213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7de85-68d2-4a8b-b36b-bf3f761ff4db None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:46.330213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7de85-68d2-4a8b-b36b-bf3f761ff4db None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:46.331719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7de85-68d2-4a8b-b36b-bf3f761ff4db None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:46.334974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 697/1371] 10.222.0.89 () {54 vars in 964 bytes} [Fri Aug 26 15:32:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:46.337729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e99a-65b2-47a0-b504-0a8dd3cccd5d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:46.338117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e99a-65b2-47a0-b504-0a8dd3cccd5d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:46.338495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e99a-65b2-47a0-b504-0a8dd3cccd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:46.419823 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c5d1e99a-65b2-47a0-b504-0a8dd3cccd5d None None] MFA Rules not processed for user `4a128a6b32fd4a54ad0146551fe77879`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:46.421170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c5d1e99a-65b2-47a0-b504-0a8dd3cccd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:46.469352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:46.501731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 675/1372] 10.222.0.89 () {58 vars in 1061 bytes} [Fri Aug 26 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:46.509597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7de85-68d2-4a8b-b36b-bf3f761ff4db None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:46.511322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-82c7de85-68d2-4a8b-b36b-bf3f761ff4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:46.566220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:46.622498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7de85-68d2-4a8b-b36b-bf3f761ff4db None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:46.702328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13e93a-42c1-4a19-a8c7-e9ffd4647666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:46.703103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13e93a-42c1-4a19-a8c7-e9ffd4647666 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:46.703417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13e93a-42c1-4a19-a8c7-e9ffd4647666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:46.703625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13e93a-42c1-4a19-a8c7-e9ffd4647666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:46.705699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9d13e93a-42c1-4a19-a8c7-e9ffd4647666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:46.836795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:46.855446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13e93a-42c1-4a19-a8c7-e9ffd4647666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:46.856856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13e93a-42c1-4a19-a8c7-e9ffd4647666 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:46.877223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 698/1373] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:46.966267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae34b5-eeff-4275-9aee-ed4b18087ecc None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:46.966779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae34b5-eeff-4275-9aee-ed4b18087ecc None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:46.967499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae34b5-eeff-4275-9aee-ed4b18087ecc None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:46.968696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 676/1374] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:46.974191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc0f9-534d-4cdb-a077-83e6a21e9e9d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:46.974678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc0f9-534d-4cdb-a077-83e6a21e9e9d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:46.974832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc0f9-534d-4cdb-a077-83e6a21e9e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:47.045862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-22acc0f9-534d-4cdb-a077-83e6a21e9e9d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:47.047114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-22acc0f9-534d-4cdb-a077-83e6a21e9e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:47.143965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 699/1375] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:47.435064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae34b5-eeff-4275-9aee-ed4b18087ecc None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:47.436588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7fae34b5-eeff-4275-9aee-ed4b18087ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:47.592477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae34b5-eeff-4275-9aee-ed4b18087ecc None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:47.646837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:47.708557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74933a-ceca-4c84-9547-57116cae569b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:47.709099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74933a-ceca-4c84-9547-57116cae569b service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:47.709496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74933a-ceca-4c84-9547-57116cae569b service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:47.709773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74933a-ceca-4c84-9547-57116cae569b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:47.711408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2e74933a-ceca-4c84-9547-57116cae569b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:47.801933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74933a-ceca-4c84-9547-57116cae569b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:47.803632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74933a-ceca-4c84-9547-57116cae569b service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:47.821708 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 677/1376] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:49.822576 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3090b98-00d8-4bd5-90e2-bccc04ef40a5 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:49.823137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3090b98-00d8-4bd5-90e2-bccc04ef40a5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:49.823234 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3090b98-00d8-4bd5-90e2-bccc04ef40a5 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:49.824549 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 700/1377] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:49.830488 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f29a9-279e-41ba-9661-97785af7ea24 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:49.830983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f29a9-279e-41ba-9661-97785af7ea24 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:49.831184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f29a9-279e-41ba-9661-97785af7ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:49.899466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-bd2f29a9-279e-41ba-9661-97785af7ea24 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:49.900681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bd2f29a9-279e-41ba-9661-97785af7ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:49.907828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:50.008639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 678/1378] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:50.308908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3090b98-00d8-4bd5-90e2-bccc04ef40a5 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:50.310440 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e3090b98-00d8-4bd5-90e2-bccc04ef40a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:50.377286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:50.495604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3090b98-00d8-4bd5-90e2-bccc04ef40a5 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:50.641396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68da4cf-98b8-43bc-ac48-f01d01651771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:50.642089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68da4cf-98b8-43bc-ac48-f01d01651771 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:50.642462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68da4cf-98b8-43bc-ac48-f01d01651771 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:50.642828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68da4cf-98b8-43bc-ac48-f01d01651771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:50.644818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a68da4cf-98b8-43bc-ac48-f01d01651771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:50.665675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:50.747963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68da4cf-98b8-43bc-ac48-f01d01651771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:50.749585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68da4cf-98b8-43bc-ac48-f01d01651771 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:50.771236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 701/1379] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:52.760760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ca680-c4ef-4643-8a7e-2e81eb281043 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:52.763979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ca680-c4ef-4643-8a7e-2e81eb281043 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:52.763979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ca680-c4ef-4643-8a7e-2e81eb281043 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:52.764817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 679/1380] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:52.768799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab7bc6-a3a0-4457-8ff9-20064cb380ff None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:52.769541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab7bc6-a3a0-4457-8ff9-20064cb380ff None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:52.769629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab7bc6-a3a0-4457-8ff9-20064cb380ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:52.849598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-58ab7bc6-a3a0-4457-8ff9-20064cb380ff None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:52.850796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-58ab7bc6-a3a0-4457-8ff9-20064cb380ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:52.960182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:52.970972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 702/1381] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:53.258694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ca680-c4ef-4643-8a7e-2e81eb281043 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:53.260582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-562ca680-c4ef-4643-8a7e-2e81eb281043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:53.443820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:53.461234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ca680-c4ef-4643-8a7e-2e81eb281043 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:53.636432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4232dfd-aab1-4bae-ad1e-7974dbafd089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:53.637053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232dfd-aab1-4bae-ad1e-7974dbafd089 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:53.637333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232dfd-aab1-4bae-ad1e-7974dbafd089 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:53.637603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232dfd-aab1-4bae-ad1e-7974dbafd089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:53.639262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a4232dfd-aab1-4bae-ad1e-7974dbafd089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:53.762900 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4232dfd-aab1-4bae-ad1e-7974dbafd089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:53.764624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4232dfd-aab1-4bae-ad1e-7974dbafd089 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:53.783685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:53.787618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 680/1382] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:55.832973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba685b-0098-4c5f-912a-210cc5eed62e None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:55.833504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba685b-0098-4c5f-912a-210cc5eed62e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:55.833611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba685b-0098-4c5f-912a-210cc5eed62e None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:55.835076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 703/1383] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:32:55.841269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639d0a-fb3a-4014-9bca-4e8c0a1e603d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:55.841695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639d0a-fb3a-4014-9bca-4e8c0a1e603d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:55.842036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639d0a-fb3a-4014-9bca-4e8c0a1e603d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:55.916052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-92639d0a-fb3a-4014-9bca-4e8c0a1e603d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:55.917278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-92639d0a-fb3a-4014-9bca-4e8c0a1e603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:56.015645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 681/1384] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:56.328389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba685b-0098-4c5f-912a-210cc5eed62e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:56.329991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-77ba685b-0098-4c5f-912a-210cc5eed62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:56.481378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba685b-0098-4c5f-912a-210cc5eed62e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:56.555818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:56.604846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5458-b9b1-401e-983a-91bc472f6033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:56.605376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5458-b9b1-401e-983a-91bc472f6033 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:56.605657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5458-b9b1-401e-983a-91bc472f6033 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:56.605929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5458-b9b1-401e-983a-91bc472f6033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:56.607584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-027b5458-b9b1-401e-983a-91bc472f6033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:56.699411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b5458-b9b1-401e-983a-91bc472f6033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:56.701017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b5458-b9b1-401e-983a-91bc472f6033 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:56.720135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 704/1385] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:32:58.785139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0bb6f-8a68-47d4-9f79-77203ea790ee None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:58.785679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0bb6f-8a68-47d4-9f79-77203ea790ee None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:58.786762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0bb6f-8a68-47d4-9f79-77203ea790ee None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:58.788473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 682/1386] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:32:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:32:58.794129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6782-e89e-4cc5-b8d5-98f1f340c014 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:58.794901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6782-e89e-4cc5-b8d5-98f1f340c014 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:58.794901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e6782-e89e-4cc5-b8d5-98f1f340c014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:58.867412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-233e6782-e89e-4cc5-b8d5-98f1f340c014 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:32:58.868628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-233e6782-e89e-4cc5-b8d5-98f1f340c014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:58.904972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:58.999879 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 705/1387] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:32:59.356323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0bb6f-8a68-47d4-9f79-77203ea790ee None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:32:59.357835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7ff0bb6f-8a68-47d4-9f79-77203ea790ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:59.435694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:59.509486 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0bb6f-8a68-47d4-9f79-77203ea790ee None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:32:59.627077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc8382-ee87-4103-b2b0-35e585a67913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:32:59.627683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8382-ee87-4103-b2b0-35e585a67913 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:32:59.627960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8382-ee87-4103-b2b0-35e585a67913 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:32:59.628227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8382-ee87-4103-b2b0-35e585a67913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:32:59.629816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-74cc8382-ee87-4103-b2b0-35e585a67913 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:32:59.671097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:32:59.737675 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc8382-ee87-4103-b2b0-35e585a67913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:32:59.739234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc8382-ee87-4103-b2b0-35e585a67913 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:32:59.757785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 683/1388] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:01.821730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17f06b-5946-42af-a035-99bc258ad8ec None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:01.822317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17f06b-5946-42af-a035-99bc258ad8ec None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:01.822317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17f06b-5946-42af-a035-99bc258ad8ec None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:01.823655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 706/1389] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:01.829383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c261b67-fee7-42b9-92db-5fcf484d5586 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:01.829909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c261b67-fee7-42b9-92db-5fcf484d5586 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:01.829909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c261b67-fee7-42b9-92db-5fcf484d5586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:01.902421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5c261b67-fee7-42b9-92db-5fcf484d5586 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:01.903681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5c261b67-fee7-42b9-92db-5fcf484d5586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:02.005605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 684/1390] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:02.336762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17f06b-5946-42af-a035-99bc258ad8ec None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:02.338917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cb17f06b-5946-42af-a035-99bc258ad8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:02.521886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17f06b-5946-42af-a035-99bc258ad8ec None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:02.539301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:02.661605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dd1a0-f6ce-4768-94d7-1e4f7fc55636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:02.662132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd1a0-f6ce-4768-94d7-1e4f7fc55636 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:02.662408 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd1a0-f6ce-4768-94d7-1e4f7fc55636 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:02.662676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd1a0-f6ce-4768-94d7-1e4f7fc55636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:02.664300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1d0dd1a0-f6ce-4768-94d7-1e4f7fc55636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:02.770084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dd1a0-f6ce-4768-94d7-1e4f7fc55636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:02.772981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dd1a0-f6ce-4768-94d7-1e4f7fc55636 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:02.801631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 707/1391] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:04.800903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb42abb-37d8-4f2a-98bc-7d18269ffe0f None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:04.801455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb42abb-37d8-4f2a-98bc-7d18269ffe0f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:04.801455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb42abb-37d8-4f2a-98bc-7d18269ffe0f None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:04.802798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 685/1392] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:33:04.808515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5764-997f-40dd-a4b5-26b724c01cfc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:04.808949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5764-997f-40dd-a4b5-26b724c01cfc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:04.809053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5764-997f-40dd-a4b5-26b724c01cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:04.839233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:04.883627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-24be5764-997f-40dd-a4b5-26b724c01cfc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:04.884864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-24be5764-997f-40dd-a4b5-26b724c01cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:05.007032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 708/1393] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:33:05.301362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb42abb-37d8-4f2a-98bc-7d18269ffe0f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:05.303327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-feb42abb-37d8-4f2a-98bc-7d18269ffe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:05.320533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:05.482170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb42abb-37d8-4f2a-98bc-7d18269ffe0f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:05.671502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:05.711114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728f21c-0a95-49df-b580-64e3aa02e313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:05.711945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728f21c-0a95-49df-b580-64e3aa02e313 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:05.712262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728f21c-0a95-49df-b580-64e3aa02e313 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:05.712544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728f21c-0a95-49df-b580-64e3aa02e313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:05.715202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7728f21c-0a95-49df-b580-64e3aa02e313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:05.849334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728f21c-0a95-49df-b580-64e3aa02e313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:05.851808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728f21c-0a95-49df-b580-64e3aa02e313 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:05.883397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 686/1394] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:07.833402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99a9a0-a0b7-41d9-879c-1cdf071bbe24 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:07.833943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99a9a0-a0b7-41d9-879c-1cdf071bbe24 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:07.834036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99a9a0-a0b7-41d9-879c-1cdf071bbe24 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:07.835395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 709/1395] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:07.841302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7bfa3-e2df-42f8-9502-7e4cdc17892c None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:07.841868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7bfa3-e2df-42f8-9502-7e4cdc17892c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:07.841868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7bfa3-e2df-42f8-9502-7e4cdc17892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:07.918925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-17b7bfa3-e2df-42f8-9502-7e4cdc17892c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:07.920168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-17b7bfa3-e2df-42f8-9502-7e4cdc17892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:07.982400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:08.040203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419698-0e84-4736-a60b-0c78301dd923 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:08.040525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419698-0e84-4736-a60b-0c78301dd923 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:08.040746 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419698-0e84-4736-a60b-0c78301dd923 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:08.041910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 687/1396] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:08.044151 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 710/1397] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:33:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:33:08.048783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999902ca-6db9-4c0b-a9dc-e538eaa1873c None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:08.049147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999902ca-6db9-4c0b-a9dc-e538eaa1873c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:08.049425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999902ca-6db9-4c0b-a9dc-e538eaa1873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:08.119369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-999902ca-6db9-4c0b-a9dc-e538eaa1873c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:08.120486 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-999902ca-6db9-4c0b-a9dc-e538eaa1873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:08.229216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 688/1398] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:08.353766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3d170-cd46-4449-bbfb-5da7242276e2 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:08.354169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3d170-cd46-4449-bbfb-5da7242276e2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:08.354738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3d170-cd46-4449-bbfb-5da7242276e2 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:08.356455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 711/1399] 10.222.0.89 () {54 vars in 967 bytes} [Fri Aug 26 15:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:08.362564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63abb8-9af9-4d03-87d6-054e05d1455b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:08.362851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63abb8-9af9-4d03-87d6-054e05d1455b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:08.363163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63abb8-9af9-4d03-87d6-054e05d1455b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:08.413127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:08.472174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-6c63abb8-9af9-4d03-87d6-054e05d1455b None None] MFA Rules not processed for user `4d055337c9a642bd9b8b5a60aacb11cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:08.473413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6c63abb8-9af9-4d03-87d6-054e05d1455b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:08.523596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3d170-cd46-4449-bbfb-5da7242276e2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:08.525135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-add3d170-cd46-4449-bbfb-5da7242276e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:08.565467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 689/1400] 10.222.0.89 () {58 vars in 1064 bytes} [Fri Aug 26 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:08.573246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63abb8-9af9-4d03-87d6-054e05d1455b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:08.582266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63abb8-9af9-4d03-87d6-054e05d1455b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:08.656285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:08.683712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa5dcb-51e7-4dcb-9b8b-fda628ba576a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d055337c9a642bd9b8b5a60aacb11cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:08.684238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa5dcb-51e7-4dcb-9b8b-fda628ba576a service glance] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:08.684513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa5dcb-51e7-4dcb-9b8b-fda628ba576a service glance] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:08.684778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa5dcb-51e7-4dcb-9b8b-fda628ba576a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:08.686420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-15aa5dcb-51e7-4dcb-9b8b-fda628ba576a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:08.722511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3d170-cd46-4449-bbfb-5da7242276e2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:08.752305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:08.837928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa5dcb-51e7-4dcb-9b8b-fda628ba576a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:08.840409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa5dcb-51e7-4dcb-9b8b-fda628ba576a service glance] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:08.873826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 690/1401] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:33:08.889286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd3dcc-dc7b-4a71-961e-182ca6f35a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:08.889946 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3dcc-dc7b-4a71-961e-182ca6f35a48 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:08.890174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3dcc-dc7b-4a71-961e-182ca6f35a48 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:08.890446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3dcc-dc7b-4a71-961e-182ca6f35a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:08.892711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-27cd3dcc-dc7b-4a71-961e-182ca6f35a48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:08.967548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:08.998665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd3dcc-dc7b-4a71-961e-182ca6f35a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:09.000346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd3dcc-dc7b-4a71-961e-182ca6f35a48 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:09.020038 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 712/1402] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:33:09.700092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e2ba8-858a-46ec-b715-6302551da22a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:09.700377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e2ba8-858a-46ec-b715-6302551da22a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:09.700660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e2ba8-858a-46ec-b715-6302551da22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:09.775342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b52e2ba8-858a-46ec-b715-6302551da22a None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:09.776603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b52e2ba8-858a-46ec-b715-6302551da22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:09.895021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 691/1403] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:33:09.941966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27d3b-cf62-448c-a0e1-18e993463da8 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:09.942470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27d3b-cf62-448c-a0e1-18e993463da8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:09.942470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c27d3b-cf62-448c-a0e1-18e993463da8 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:09.944200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 713/1404] 10.222.0.89 () {54 vars in 943 bytes} [Fri Aug 26 15:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:09.951667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4fce8-c390-459d-aae8-6465b0134068 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:09.952151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4fce8-c390-459d-aae8-6465b0134068 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:09.952494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4fce8-c390-459d-aae8-6465b0134068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:09.972287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:10.045349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f2e4fce8-c390-459d-aae8-6465b0134068 None None] MFA Rules not processed for user `9df361aabe544b618c7c1c1d98b8751a`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:10.047215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f2e4fce8-c390-459d-aae8-6465b0134068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:10.197647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 692/1405] 10.222.0.89 () {58 vars in 1040 bytes} [Fri Aug 26 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:10.208777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27d3b-cf62-448c-a0e1-18e993463da8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:10.210372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a4c27d3b-cf62-448c-a0e1-18e993463da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:10.365985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c27d3b-cf62-448c-a0e1-18e993463da8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:10.424640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:10.489325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8d3a1-e8b7-4c67-b8bc-346e5624ba85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:10.489912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d3a1-e8b7-4c67-b8bc-346e5624ba85 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:10.490054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d3a1-e8b7-4c67-b8bc-346e5624ba85 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:10.490322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d3a1-e8b7-4c67-b8bc-346e5624ba85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:10.492002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-45e8d3a1-e8b7-4c67-b8bc-346e5624ba85 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:10.590481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8d3a1-e8b7-4c67-b8bc-346e5624ba85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:10.592372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8d3a1-e8b7-4c67-b8bc-346e5624ba85 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:10.601596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 714/1406] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:33:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:33:11.096756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb28f2-29c8-4e44-8b37-ffa1e81811a5 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:11.097467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb28f2-29c8-4e44-8b37-ffa1e81811a5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:11.097467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb28f2-29c8-4e44-8b37-ffa1e81811a5 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:11.098577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 693/1407] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:11.106106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c4973-a269-4ca6-a460-54e9003f5fc9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:11.106896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c4973-a269-4ca6-a460-54e9003f5fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:11.107559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c4973-a269-4ca6-a460-54e9003f5fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:11.225133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5f1c4973-a269-4ca6-a460-54e9003f5fc9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:11.226738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5f1c4973-a269-4ca6-a460-54e9003f5fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:11.281791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:11.386148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 715/1408] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:11.721218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb28f2-29c8-4e44-8b37-ffa1e81811a5 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:11.722757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8cdb28f2-29c8-4e44-8b37-ffa1e81811a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:11.855642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:11.950388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb28f2-29c8-4e44-8b37-ffa1e81811a5 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:12.100042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707e2c0-ba33-420d-bdd5-a7568b87bb9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:12.100963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707e2c0-ba33-420d-bdd5-a7568b87bb9c service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:12.101081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707e2c0-ba33-420d-bdd5-a7568b87bb9c service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:12.101324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707e2c0-ba33-420d-bdd5-a7568b87bb9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:12.103034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6707e2c0-ba33-420d-bdd5-a7568b87bb9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:12.149380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:12.217814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707e2c0-ba33-420d-bdd5-a7568b87bb9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:12.219992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707e2c0-ba33-420d-bdd5-a7568b87bb9c service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:12.241575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 694/1409] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:21.380549 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=28 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:22.238716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=30 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:32.817414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb288b5-77e6-4602-b0a4-fa2cbf1e48df None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:32.818031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb288b5-77e6-4602-b0a4-fa2cbf1e48df None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:32.818031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb288b5-77e6-4602-b0a4-fa2cbf1e48df None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:32.819452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 716/1410] 10.222.0.89 () {54 vars in 918 bytes} [Fri Aug 26 15:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:32.824605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed093b5b-ef1f-4438-918f-4662a16a84f7 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:32.825052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed093b5b-ef1f-4438-918f-4662a16a84f7 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:32.825163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed093b5b-ef1f-4438-918f-4662a16a84f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:32.904255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ed093b5b-ef1f-4438-918f-4662a16a84f7 None None] MFA Rules not processed for user `8d086e815c1542d1ba9daf81e644166a`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:32.905500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ed093b5b-ef1f-4438-918f-4662a16a84f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:33.013674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 695/1411] 10.222.0.89 () {58 vars in 1015 bytes} [Fri Aug 26 15:33:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:33.028288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfee28-fa44-4c2a-9f27-64347015a6fb None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:33.028573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfee28-fa44-4c2a-9f27-64347015a6fb None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:33.028845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfee28-fa44-4c2a-9f27-64347015a6fb None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:33.030181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 717/1412] 10.222.0.89 () {54 vars in 918 bytes} [Fri Aug 26 15:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:33.035183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc3274-206e-4a44-ab35-e590202fc336 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:33.035471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc3274-206e-4a44-ab35-e590202fc336 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:33.035746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc3274-206e-4a44-ab35-e590202fc336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:33.148038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:33.152679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-89fc3274-206e-4a44-ab35-e590202fc336 None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:33.155159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-89fc3274-206e-4a44-ab35-e590202fc336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:33.282232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 696/1413] 10.222.0.89 () {58 vars in 1015 bytes} [Fri Aug 26 15:33:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:33:35.688766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7275655-adbf-44fa-a0b4-20fa5f98e1c7 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:35.689329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7275655-adbf-44fa-a0b4-20fa5f98e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:35.689329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7275655-adbf-44fa-a0b4-20fa5f98e1c7 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:35.690634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:35.696113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecf9d1-b125-4c0c-ba8d-b847dd794706 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:35.696546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecf9d1-b125-4c0c-ba8d-b847dd794706 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:35.696696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecf9d1-b125-4c0c-ba8d-b847dd794706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:35.769088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b6ecf9d1-b125-4c0c-ba8d-b847dd794706 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:35.770338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b6ecf9d1-b125-4c0c-ba8d-b847dd794706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:35.834172 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:35.878744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:36.167395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7275655-adbf-44fa-a0b4-20fa5f98e1c7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:36.169147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f7275655-adbf-44fa-a0b4-20fa5f98e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:36.320627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7275655-adbf-44fa-a0b4-20fa5f98e1c7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:36.395068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:36.436809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df5619-4a1b-4523-8adb-8c253844a1eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:36.437456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df5619-4a1b-4523-8adb-8c253844a1eb service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:36.437777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df5619-4a1b-4523-8adb-8c253844a1eb service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:36.438106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df5619-4a1b-4523-8adb-8c253844a1eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:36.439824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-46df5619-4a1b-4523-8adb-8c253844a1eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:36.528802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df5619-4a1b-4523-8adb-8c253844a1eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:36.531014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df5619-4a1b-4523-8adb-8c253844a1eb service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:36.549733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 719/1416] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:37.447907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7d5d-5a58-44ef-bcfd-88da33b38479 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:37.448472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7d5d-5a58-44ef-bcfd-88da33b38479 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:37.448472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7d5d-5a58-44ef-bcfd-88da33b38479 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:37.449876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:37.455616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651b04a-a23c-495b-9fc5-ef4bfd38cdbf None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:37.456113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651b04a-a23c-495b-9fc5-ef4bfd38cdbf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:37.456211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651b04a-a23c-495b-9fc5-ef4bfd38cdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:37.536502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9651b04a-a23c-495b-9fc5-ef4bfd38cdbf None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:37.537727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9651b04a-a23c-495b-9fc5-ef4bfd38cdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:37.567594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:37.642439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:37.797772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd7d5d-5a58-44ef-bcfd-88da33b38479 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:37.799503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-06dd7d5d-5a58-44ef-bcfd-88da33b38479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:37.949139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd7d5d-5a58-44ef-bcfd-88da33b38479 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:37.991875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:38.067579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc38e89-f3b1-460a-b727-895156382f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:38.068348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc38e89-f3b1-460a-b727-895156382f1b service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:38.068619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc38e89-f3b1-460a-b727-895156382f1b service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:38.068884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc38e89-f3b1-460a-b727-895156382f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:38.070563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-edc38e89-f3b1-460a-b727-895156382f1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:38.160853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc38e89-f3b1-460a-b727-895156382f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:38.162572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc38e89-f3b1-460a-b727-895156382f1b service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:38.181247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 699/1419] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:39.071661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf4ee-b1d6-4875-b9bd-fdc78860ecdf None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:39.072199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf4ee-b1d6-4875-b9bd-fdc78860ecdf None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:39.072199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf4ee-b1d6-4875-b9bd-fdc78860ecdf None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:39.073503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:39.078970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4157397-7d93-4f9d-9806-cf7403befb55 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:39.079424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4157397-7d93-4f9d-9806-cf7403befb55 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:39.079530 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4157397-7d93-4f9d-9806-cf7403befb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:39.134607 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:39.158605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-d4157397-7d93-4f9d-9806-cf7403befb55 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:39.159860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d4157397-7d93-4f9d-9806-cf7403befb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:39.263764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:33:39.415397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf4ee-b1d6-4875-b9bd-fdc78860ecdf None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:39.417132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8eeaf4ee-b1d6-4875-b9bd-fdc78860ecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:39.570270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf4ee-b1d6-4875-b9bd-fdc78860ecdf None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:39.584001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:39.696098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b44495-c0c0-4822-8458-bfe4cfbeb49b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:39.696098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b44495-c0c0-4822-8458-bfe4cfbeb49b service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:39.696478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b44495-c0c0-4822-8458-bfe4cfbeb49b service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:39.697567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b44495-c0c0-4822-8458-bfe4cfbeb49b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:39.698322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-53b44495-c0c0-4822-8458-bfe4cfbeb49b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:39.800307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b44495-c0c0-4822-8458-bfe4cfbeb49b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:39.801973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b44495-c0c0-4822-8458-bfe4cfbeb49b service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:39.821594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 722/1422] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:40.760622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021eca5-5c7d-45b5-9c1a-72e64018de17 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:40.761386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021eca5-5c7d-45b5-9c1a-72e64018de17 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:40.761386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021eca5-5c7d-45b5-9c1a-72e64018de17 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:40.762692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:40.769786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84739-dc29-47c1-858d-499542d033bc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:40.773226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84739-dc29-47c1-858d-499542d033bc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:40.773226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84739-dc29-47c1-858d-499542d033bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:40.804104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:40.893217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-66d84739-dc29-47c1-858d-499542d033bc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:40.895839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-66d84739-dc29-47c1-858d-499542d033bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:41.024926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:41.184746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021eca5-5c7d-45b5-9c1a-72e64018de17 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:41.187381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-0021eca5-5c7d-45b5-9c1a-72e64018de17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:41.353463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:41.410833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021eca5-5c7d-45b5-9c1a-72e64018de17 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:41.579277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe4b87-d948-43be-99de-54d0ba063bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:41.579926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe4b87-d948-43be-99de-54d0ba063bbf service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:41.580205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe4b87-d948-43be-99de-54d0ba063bbf service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:41.580478 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe4b87-d948-43be-99de-54d0ba063bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:41.582147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6dfe4b87-d948-43be-99de-54d0ba063bbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:41.697289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:41.723649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe4b87-d948-43be-99de-54d0ba063bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:41.726162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe4b87-d948-43be-99de-54d0ba063bbf service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:41.751435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 702/1425] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:33:42.725429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387859-027a-41a2-b93c-14d2f6c0deb9 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:42.726064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387859-027a-41a2-b93c-14d2f6c0deb9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:42.726489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47387859-027a-41a2-b93c-14d2f6c0deb9 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:42.729029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:42.736372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc217-85a4-4379-a4e1-3091ac0937c5 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:42.737142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc217-85a4-4379-a4e1-3091ac0937c5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:42.737142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc217-85a4-4379-a4e1-3091ac0937c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:42.846052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f84bc217-85a4-4379-a4e1-3091ac0937c5 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:42.847342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f84bc217-85a4-4379-a4e1-3091ac0937c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:42.970118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:43.127128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387859-027a-41a2-b93c-14d2f6c0deb9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:43.128711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-47387859-027a-41a2-b93c-14d2f6c0deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:43.223243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:43.293576 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47387859-027a-41a2-b93c-14d2f6c0deb9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:43.427177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac74f3a-5abe-4692-9ae9-97dfbb79b493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:43.427816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac74f3a-5abe-4692-9ae9-97dfbb79b493 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:43.428091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac74f3a-5abe-4692-9ae9-97dfbb79b493 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:43.428359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac74f3a-5abe-4692-9ae9-97dfbb79b493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:43.430211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8ac74f3a-5abe-4692-9ae9-97dfbb79b493 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:43.495778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:43.543667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac74f3a-5abe-4692-9ae9-97dfbb79b493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:43.545206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac74f3a-5abe-4692-9ae9-97dfbb79b493 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:43.565622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 725/1428] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:44.403872 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094f3f-e90a-4194-8446-5986e6def306 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:44.404419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094f3f-e90a-4194-8446-5986e6def306 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:44.404419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094f3f-e90a-4194-8446-5986e6def306 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:44.406400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:44.411764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f53b0-e828-4999-aa21-6b25817355f2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:44.412241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f53b0-e828-4999-aa21-6b25817355f2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:44.412336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f53b0-e828-4999-aa21-6b25817355f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:44.488115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c77f53b0-e828-4999-aa21-6b25817355f2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:44.489310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c77f53b0-e828-4999-aa21-6b25817355f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:44.588046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:44.739306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24094f3f-e90a-4194-8446-5986e6def306 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:44.740728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-24094f3f-e90a-4194-8446-5986e6def306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:44.790872 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:44.893789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24094f3f-e90a-4194-8446-5986e6def306 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:45.008545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512b879-a6c7-4d0d-92dc-65c27648a698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:45.009071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512b879-a6c7-4d0d-92dc-65c27648a698 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:45.009440 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512b879-a6c7-4d0d-92dc-65c27648a698 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:45.009714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512b879-a6c7-4d0d-92dc-65c27648a698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:45.011488 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7512b879-a6c7-4d0d-92dc-65c27648a698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:45.019738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:45.104096 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512b879-a6c7-4d0d-92dc-65c27648a698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:45.105705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512b879-a6c7-4d0d-92dc-65c27648a698 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:45.127564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 705/1431] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:45.952022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc000-b7c4-43b1-a20b-7c903d7bec85 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:45.953074 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc000-b7c4-43b1-a20b-7c903d7bec85 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:45.953193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc000-b7c4-43b1-a20b-7c903d7bec85 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:45.954450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:45.959589 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948985ad-1a58-4d7a-a9d2-85e83ce3017e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:45.960051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948985ad-1a58-4d7a-a9d2-85e83ce3017e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:45.960146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948985ad-1a58-4d7a-a9d2-85e83ce3017e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:46.036599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-948985ad-1a58-4d7a-a9d2-85e83ce3017e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:46.037809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-948985ad-1a58-4d7a-a9d2-85e83ce3017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:46.107056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:46.136350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:46.288358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc000-b7c4-43b1-a20b-7c903d7bec85 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:46.289984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-687fc000-b7c4-43b1-a20b-7c903d7bec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:46.308389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:46.439870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc000-b7c4-43b1-a20b-7c903d7bec85 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:46.528679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:46.557692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974f12b-b78d-4370-98f9-a7ee7e3ce05f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:46.558313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f12b-b78d-4370-98f9-a7ee7e3ce05f service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:46.558610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f12b-b78d-4370-98f9-a7ee7e3ce05f service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:46.558844 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974f12b-b78d-4370-98f9-a7ee7e3ce05f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:46.560515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3974f12b-b78d-4370-98f9-a7ee7e3ce05f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:46.669840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974f12b-b78d-4370-98f9-a7ee7e3ce05f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:46.671690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974f12b-b78d-4370-98f9-a7ee7e3ce05f service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:46.699144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 728/1434] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:47.534861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80cde-d2bd-4df9-9639-1fbb088907d7 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:47.535637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80cde-d2bd-4df9-9639-1fbb088907d7 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:47.535637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f80cde-d2bd-4df9-9639-1fbb088907d7 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:47.536976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:47.546464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650aafdc-96a7-40a8-bb14-8a8f4c63d453 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:47.547470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650aafdc-96a7-40a8-bb14-8a8f4c63d453 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:47.547625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650aafdc-96a7-40a8-bb14-8a8f4c63d453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:47.645654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-650aafdc-96a7-40a8-bb14-8a8f4c63d453 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:47.646756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-650aafdc-96a7-40a8-bb14-8a8f4c63d453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:47.694837 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:47.759895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:47.920886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80cde-d2bd-4df9-9639-1fbb088907d7 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:47.922950 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e6f80cde-d2bd-4df9-9639-1fbb088907d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:48.087046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f80cde-d2bd-4df9-9639-1fbb088907d7 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:48.145018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:48.224752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ae24a-c2da-4b00-820e-75466cae48fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:48.225696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ae24a-c2da-4b00-820e-75466cae48fd service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:48.226218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ae24a-c2da-4b00-820e-75466cae48fd service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:48.226680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ae24a-c2da-4b00-820e-75466cae48fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:48.229817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-618ae24a-c2da-4b00-820e-75466cae48fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:48.344718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ae24a-c2da-4b00-820e-75466cae48fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:48.347533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ae24a-c2da-4b00-820e-75466cae48fd service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:48.368171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 708/1437] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:49.207054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ea279-a8a3-41ba-8f84-df80dbf28855 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:49.207751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ea279-a8a3-41ba-8f84-df80dbf28855 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:49.207751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ea279-a8a3-41ba-8f84-df80dbf28855 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:49.208959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:49.214843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784ee7-280b-430a-b35e-98980a555045 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:49.215482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784ee7-280b-430a-b35e-98980a555045 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:49.215597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a784ee7-280b-430a-b35e-98980a555045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:49.299254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5a784ee7-280b-430a-b35e-98980a555045 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:49.300499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5a784ee7-280b-430a-b35e-98980a555045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:49.302903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:49.418597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:49.571936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ea279-a8a3-41ba-8f84-df80dbf28855 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:49.573467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e22ea279-a8a3-41ba-8f84-df80dbf28855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:49.738668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ea279-a8a3-41ba-8f84-df80dbf28855 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:49.767944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:49.873515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab6eb7-b4c8-4ba1-84cd-e356c7e170b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:49.874860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab6eb7-b4c8-4ba1-84cd-e356c7e170b9 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:49.875201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab6eb7-b4c8-4ba1-84cd-e356c7e170b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:49.875510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab6eb7-b4c8-4ba1-84cd-e356c7e170b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:49.877529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-beab6eb7-b4c8-4ba1-84cd-e356c7e170b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:49.976462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab6eb7-b4c8-4ba1-84cd-e356c7e170b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:49.978079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab6eb7-b4c8-4ba1-84cd-e356c7e170b9 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:49.997502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 731/1440] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:51.903890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39317a-083b-41bc-9ff1-0dfc56824ca2 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:51.904844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39317a-083b-41bc-9ff1-0dfc56824ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:51.904844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39317a-083b-41bc-9ff1-0dfc56824ca2 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:51.907251 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:51.913803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4574a-addc-4922-b848-967a87c50338 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:51.914439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4574a-addc-4922-b848-967a87c50338 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:51.914439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4574a-addc-4922-b848-967a87c50338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:51.969577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:52.001900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-49c4574a-addc-4922-b848-967a87c50338 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:52.003147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-49c4574a-addc-4922-b848-967a87c50338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:52.111160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:52.406734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39317a-083b-41bc-9ff1-0dfc56824ca2 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:52.408351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-0b39317a-083b-41bc-9ff1-0dfc56824ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:52.543072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39317a-083b-41bc-9ff1-0dfc56824ca2 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:52.579632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:52.626200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59673-ca0d-44ac-96b0-d21e38e0596b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:52.626802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59673-ca0d-44ac-96b0-d21e38e0596b service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:52.627116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59673-ca0d-44ac-96b0-d21e38e0596b service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:52.627406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59673-ca0d-44ac-96b0-d21e38e0596b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:52.629011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9eb59673-ca0d-44ac-96b0-d21e38e0596b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:52.884531 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59673-ca0d-44ac-96b0-d21e38e0596b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:52.886225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59673-ca0d-44ac-96b0-d21e38e0596b service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:52.906700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 711/1443] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:55.096643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369251-6d6b-4727-aecb-730e7be27dd3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:55.097182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369251-6d6b-4727-aecb-730e7be27dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:55.097182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369251-6d6b-4727-aecb-730e7be27dd3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:55.098495 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:55.104235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1272844-ee8e-49cf-9df9-b55aa245dd13 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:55.104695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1272844-ee8e-49cf-9df9-b55aa245dd13 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:55.104798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1272844-ee8e-49cf-9df9-b55aa245dd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:55.181997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b1272844-ee8e-49cf-9df9-b55aa245dd13 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:55.183570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b1272844-ee8e-49cf-9df9-b55aa245dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:55.197370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:55.283496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:33:55.578311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369251-6d6b-4727-aecb-730e7be27dd3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:55.580077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f1369251-6d6b-4727-aecb-730e7be27dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:55.694002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369251-6d6b-4727-aecb-730e7be27dd3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:55.707488 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:55.772682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0b921-2447-476d-9f65-684e36f68cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:55.773325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0b921-2447-476d-9f65-684e36f68cac service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:55.773574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0b921-2447-476d-9f65-684e36f68cac service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:55.773849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0b921-2447-476d-9f65-684e36f68cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:55.775674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4da0b921-2447-476d-9f65-684e36f68cac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:55.906788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0b921-2447-476d-9f65-684e36f68cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:55.908249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0b921-2447-476d-9f65-684e36f68cac service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:55.926499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 734/1446] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:33:58.362460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af941465-37ae-4486-8cf7-a00dac0e868a None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:58.363084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af941465-37ae-4486-8cf7-a00dac0e868a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:58.363187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af941465-37ae-4486-8cf7-a00dac0e868a None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:58.364830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:33:58.372623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4c83-407a-4db6-8b02-84d651053135 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:58.373452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4c83-407a-4db6-8b02-84d651053135 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:58.373452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4c83-407a-4db6-8b02-84d651053135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:58.429704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:58.450910 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d3be4c83-407a-4db6-8b02-84d651053135 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:33:58.452201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d3be4c83-407a-4db6-8b02-84d651053135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:58.560568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:33:58.857868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af941465-37ae-4486-8cf7-a00dac0e868a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:33:58.859805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-af941465-37ae-4486-8cf7-a00dac0e868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:58.973603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af941465-37ae-4486-8cf7-a00dac0e868a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:33:59.016750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:33:59.057118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87b8b5-b4d5-4039-b05b-64dbcedceaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:33:59.057957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87b8b5-b4d5-4039-b05b-64dbcedceaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:33:59.058232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87b8b5-b4d5-4039-b05b-64dbcedceaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:33:59.058630 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87b8b5-b4d5-4039-b05b-64dbcedceaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:33:59.060540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8e87b8b5-b4d5-4039-b05b-64dbcedceaa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:33:59.183833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87b8b5-b4d5-4039-b05b-64dbcedceaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:33:59.185282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87b8b5-b4d5-4039-b05b-64dbcedceaa0 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:33:59.210159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 714/1449] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:01.298124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f640-53c0-482a-bf3d-3b6520289644 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:01.298707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f640-53c0-482a-bf3d-3b6520289644 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:01.298819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f640-53c0-482a-bf3d-3b6520289644 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:01.300203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:01.305747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5d58-925a-481c-933e-17a06be27e58 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:01.306189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5d58-925a-481c-933e-17a06be27e58 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:01.306292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5d58-925a-481c-933e-17a06be27e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:01.386032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-978f5d58-925a-481c-933e-17a06be27e58 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:01.387520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-978f5d58-925a-481c-933e-17a06be27e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:01.413437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:01.511395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:01.837558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689f640-53c0-482a-bf3d-3b6520289644 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:01.839161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0689f640-53c0-482a-bf3d-3b6520289644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:01.954182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689f640-53c0-482a-bf3d-3b6520289644 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:01.976453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:02.038607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc01740-fe02-4d13-ae9b-569f064f65ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:02.039259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc01740-fe02-4d13-ae9b-569f064f65ce service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:02.039669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc01740-fe02-4d13-ae9b-569f064f65ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:02.039950 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc01740-fe02-4d13-ae9b-569f064f65ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:02.041858 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1bc01740-fe02-4d13-ae9b-569f064f65ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:02.180401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc01740-fe02-4d13-ae9b-569f064f65ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:02.182149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc01740-fe02-4d13-ae9b-569f064f65ce service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:02.203698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 737/1452] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:04.268869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8daed2-45f3-47f0-9257-2b6915684110 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:04.269420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8daed2-45f3-47f0-9257-2b6915684110 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:04.269420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8daed2-45f3-47f0-9257-2b6915684110 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:04.270703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:04.276128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec706c5-998e-4927-917d-c0f3e761c555 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:04.276589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec706c5-998e-4927-917d-c0f3e761c555 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:04.276717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec706c5-998e-4927-917d-c0f3e761c555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:04.358092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:04.361673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-eec706c5-998e-4927-917d-c0f3e761c555 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:04.363293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-eec706c5-998e-4927-917d-c0f3e761c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:04.480979 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:04.826563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8daed2-45f3-47f0-9257-2b6915684110 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:04.828500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2f8daed2-45f3-47f0-9257-2b6915684110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:04.955335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8daed2-45f3-47f0-9257-2b6915684110 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:05.015661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:05.045905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd41018-bcac-4d9a-91c2-1563390da0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:05.046490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd41018-bcac-4d9a-91c2-1563390da0dd service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:05.046770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd41018-bcac-4d9a-91c2-1563390da0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:05.047088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd41018-bcac-4d9a-91c2-1563390da0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:05.048714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ecd41018-bcac-4d9a-91c2-1563390da0dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:05.181053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd41018-bcac-4d9a-91c2-1563390da0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:05.183366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd41018-bcac-4d9a-91c2-1563390da0dd service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:05.207370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 717/1455] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:07.268473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd88769-f1a5-4e7a-ae0b-b8221f3aeb05 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:07.269025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd88769-f1a5-4e7a-ae0b-b8221f3aeb05 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:07.269025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd88769-f1a5-4e7a-ae0b-b8221f3aeb05 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:07.270316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:07.276165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763872-21c6-4844-8dd1-79896ba9ddb2 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:07.276673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763872-21c6-4844-8dd1-79896ba9ddb2 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:07.276778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763872-21c6-4844-8dd1-79896ba9ddb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:07.349651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-d6763872-21c6-4844-8dd1-79896ba9ddb2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:07.350873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d6763872-21c6-4844-8dd1-79896ba9ddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:07.381220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:07.456301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:07.744033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd88769-f1a5-4e7a-ae0b-b8221f3aeb05 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:07.745579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9fd88769-f1a5-4e7a-ae0b-b8221f3aeb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:07.877346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd88769-f1a5-4e7a-ae0b-b8221f3aeb05 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:07.924559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:07.978670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56098bee-8696-4a27-ae87-67de0d857fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:07.979416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098bee-8696-4a27-ae87-67de0d857fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:07.979737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098bee-8696-4a27-ae87-67de0d857fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:07.980045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56098bee-8696-4a27-ae87-67de0d857fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:07.981958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-56098bee-8696-4a27-ae87-67de0d857fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:08.116621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56098bee-8696-4a27-ae87-67de0d857fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:08.118072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56098bee-8696-4a27-ae87-67de0d857fe6 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:08.136790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 740/1458] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:10.463167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79847780-6fda-4632-8374-899f66b73301 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:10.463912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79847780-6fda-4632-8374-899f66b73301 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:10.464095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79847780-6fda-4632-8374-899f66b73301 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:10.466519 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:10.473002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401903b6-4014-4535-8603-8e1981a48673 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:10.473543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401903b6-4014-4535-8603-8e1981a48673 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:10.473650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401903b6-4014-4535-8603-8e1981a48673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:10.556873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-401903b6-4014-4535-8603-8e1981a48673 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:10.558333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-401903b6-4014-4535-8603-8e1981a48673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:10.569863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:10.685285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:10.972469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79847780-6fda-4632-8374-899f66b73301 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:10.974961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-79847780-6fda-4632-8374-899f66b73301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:11.102124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79847780-6fda-4632-8374-899f66b73301 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:11.164874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:11.186808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d87c31-a860-4bf4-87d8-823e3a8bc680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:11.188329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87c31-a860-4bf4-87d8-823e3a8bc680 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:11.188329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87c31-a860-4bf4-87d8-823e3a8bc680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:11.188329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87c31-a860-4bf4-87d8-823e3a8bc680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:11.189600 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-93d87c31-a860-4bf4-87d8-823e3a8bc680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:11.321119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87c31-a860-4bf4-87d8-823e3a8bc680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:11.322595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87c31-a860-4bf4-87d8-823e3a8bc680 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:11.346256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 720/1461] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:13.410095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48191d31-2187-41e9-8724-a7f81af81470 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:13.410516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48191d31-2187-41e9-8724-a7f81af81470 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:13.410708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48191d31-2187-41e9-8724-a7f81af81470 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:13.412456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:13.418667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15247675-e029-46ab-93f5-a737103dc5c4 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:13.419568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15247675-e029-46ab-93f5-a737103dc5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:13.419759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15247675-e029-46ab-93f5-a737103dc5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:13.505009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-15247675-e029-46ab-93f5-a737103dc5c4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:13.506391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-15247675-e029-46ab-93f5-a737103dc5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:13.553859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:13.628445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:13.917096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48191d31-2187-41e9-8724-a7f81af81470 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:13.918646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-48191d31-2187-41e9-8724-a7f81af81470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:14.029862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48191d31-2187-41e9-8724-a7f81af81470 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:14.073568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:14.113086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45daff6b-cc0e-4de3-a276-12b8edbe48f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:14.113703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daff6b-cc0e-4de3-a276-12b8edbe48f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:14.113989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daff6b-cc0e-4de3-a276-12b8edbe48f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:14.114262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daff6b-cc0e-4de3-a276-12b8edbe48f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:14.115922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-45daff6b-cc0e-4de3-a276-12b8edbe48f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:14.253939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45daff6b-cc0e-4de3-a276-12b8edbe48f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:14.255670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45daff6b-cc0e-4de3-a276-12b8edbe48f7 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:14.278355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 743/1464] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:16.268560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7010-7b81-4de1-951d-ef1d377ca52a None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:16.269087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7010-7b81-4de1-951d-ef1d377ca52a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:16.269087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca7010-7b81-4de1-951d-ef1d377ca52a None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:16.270419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:16.276571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534320d-62eb-4f7f-b4b6-8fffbc9cfade None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:16.277106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534320d-62eb-4f7f-b4b6-8fffbc9cfade None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:16.277106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534320d-62eb-4f7f-b4b6-8fffbc9cfade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:16.353549 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b534320d-62eb-4f7f-b4b6-8fffbc9cfade None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:16.354823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b534320d-62eb-4f7f-b4b6-8fffbc9cfade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:16.375574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:16.460574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:16.767662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca7010-7b81-4de1-951d-ef1d377ca52a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:16.769465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e2ca7010-7b81-4de1-951d-ef1d377ca52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:16.904225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca7010-7b81-4de1-951d-ef1d377ca52a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:16.993486 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:17.001941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd8098-6eb2-45e5-92da-1499ed1b8dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:17.002689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd8098-6eb2-45e5-92da-1499ed1b8dfe service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:17.003133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd8098-6eb2-45e5-92da-1499ed1b8dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:17.003508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd8098-6eb2-45e5-92da-1499ed1b8dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:17.005368 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-93fd8098-6eb2-45e5-92da-1499ed1b8dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:17.135963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd8098-6eb2-45e5-92da-1499ed1b8dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:17.138291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd8098-6eb2-45e5-92da-1499ed1b8dfe service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:17.163328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 723/1467] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:19.135908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f0803-b9b7-424b-b56a-ee476beea427 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:19.136586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f0803-b9b7-424b-b56a-ee476beea427 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:19.136586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f0803-b9b7-424b-b56a-ee476beea427 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:19.137703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:19.148238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00cb4e-3998-4dbf-be3d-8192762f1117 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:19.149057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00cb4e-3998-4dbf-be3d-8192762f1117 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:19.149531 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00cb4e-3998-4dbf-be3d-8192762f1117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:19.240295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-dd00cb4e-3998-4dbf-be3d-8192762f1117 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:19.241501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-dd00cb4e-3998-4dbf-be3d-8192762f1117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:19.292182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:19.342907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:19.642397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f0803-b9b7-424b-b56a-ee476beea427 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:19.644243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-351f0803-b9b7-424b-b56a-ee476beea427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:19.759686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f0803-b9b7-424b-b56a-ee476beea427 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:19.816826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:19.851940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc1492-8629-4689-ab26-e61556a7384d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:19.852558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc1492-8629-4689-ab26-e61556a7384d service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:19.852839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc1492-8629-4689-ab26-e61556a7384d service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:19.853110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc1492-8629-4689-ab26-e61556a7384d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:19.854732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-49cc1492-8629-4689-ab26-e61556a7384d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:19.985899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc1492-8629-4689-ab26-e61556a7384d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:19.987385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc1492-8629-4689-ab26-e61556a7384d service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:20.010346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 746/1470] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:29.340443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=22 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:30.007340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=66 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:40.114008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843f7ec-8973-481c-a663-e4808a9cd117 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:40.114533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843f7ec-8973-481c-a663-e4808a9cd117 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:40.114533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843f7ec-8973-481c-a663-e4808a9cd117 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:40.115832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 725/1471] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:40.121310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41eac8-d19f-4fcf-8b47-cbb3e7a830f1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:40.121827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41eac8-d19f-4fcf-8b47-cbb3e7a830f1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:40.121956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41eac8-d19f-4fcf-8b47-cbb3e7a830f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:40.211879 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-eb41eac8-d19f-4fcf-8b47-cbb3e7a830f1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:40.213303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-eb41eac8-d19f-4fcf-8b47-cbb3e7a830f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:40.443509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 747/1472] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:40.774892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9bfbf-df58-4c2e-828b-d641c2846722 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:40.775330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9bfbf-df58-4c2e-828b-d641c2846722 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:40.775699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9bfbf-df58-4c2e-828b-d641c2846722 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:40.777393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 726/1473] 10.222.0.89 () {54 vars in 967 bytes} [Fri Aug 26 15:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:40.783821 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55805f61-fbcf-44bc-bf1d-fd0333078ca9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:40.784283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55805f61-fbcf-44bc-bf1d-fd0333078ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:40.784677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55805f61-fbcf-44bc-bf1d-fd0333078ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:40.876338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-55805f61-fbcf-44bc-bf1d-fd0333078ca9 None None] MFA Rules not processed for user `4d055337c9a642bd9b8b5a60aacb11cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:40.877586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-55805f61-fbcf-44bc-bf1d-fd0333078ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:40.899832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:40.965603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 748/1474] 10.222.0.89 () {58 vars in 1064 bytes} [Fri Aug 26 15:34:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:34:40.973478 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9bfbf-df58-4c2e-828b-d641c2846722 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:40.975043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-35e9bfbf-df58-4c2e-828b-d641c2846722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:41.098852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9bfbf-df58-4c2e-828b-d641c2846722 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:41.181794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19512c60-32e8-4bcd-83e2-798f36654b6b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d055337c9a642bd9b8b5a60aacb11cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:41.182468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512c60-32e8-4bcd-83e2-798f36654b6b service glance] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:41.182818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512c60-32e8-4bcd-83e2-798f36654b6b service glance] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:41.183208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512c60-32e8-4bcd-83e2-798f36654b6b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:41.185658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-19512c60-32e8-4bcd-83e2-798f36654b6b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:41.248387 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:41.306023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512c60-32e8-4bcd-83e2-798f36654b6b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:41.307576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512c60-32e8-4bcd-83e2-798f36654b6b service glance] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:41.327941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 727/1475] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:43.484078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc5f58-1c8c-42e6-a600-9c4384efca37 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:43.484614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc5f58-1c8c-42e6-a600-9c4384efca37 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:43.484730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc5f58-1c8c-42e6-a600-9c4384efca37 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:43.486202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 749/1476] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:43.491880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2614a-5922-4c96-af8d-4ac7e21fedee None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:43.492329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2614a-5922-4c96-af8d-4ac7e21fedee None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:43.492439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2614a-5922-4c96-af8d-4ac7e21fedee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:43.587318 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4af2614a-5922-4c96-af8d-4ac7e21fedee None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:43.588638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4af2614a-5922-4c96-af8d-4ac7e21fedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:43.697081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 728/1477] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:44.231685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc5f58-1c8c-42e6-a600-9c4384efca37 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:44.233918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b2fc5f58-1c8c-42e6-a600-9c4384efca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:44.360779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc5f58-1c8c-42e6-a600-9c4384efca37 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:44.411334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:44.455828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342ef04-3d94-4ab8-9482-47128ba44ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:44.456495 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342ef04-3d94-4ab8-9482-47128ba44ada admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:44.456718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342ef04-3d94-4ab8-9482-47128ba44ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:44.456988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342ef04-3d94-4ab8-9482-47128ba44ada admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:44.457635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342ef04-3d94-4ab8-9482-47128ba44ada admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:44.459430 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-9342ef04-3d94-4ab8-9482-47128ba44ada admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:34:44.459430 dv-cinder-831247-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Aug 26 15:34:44.459430 dv-cinder-831247-24-smb devstack@keystone.service[81766]: Aug 26 15:34:44.460543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342ef04-3d94-4ab8-9482-47128ba44ada admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:44.480165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 750/1478] 10.222.0.89 () {56 vars in 1108 bytes} [Fri Aug 26 15:34:44 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:34:46.435996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554ea42-0545-442a-8d76-240e86111e8d None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:46.436547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554ea42-0545-442a-8d76-240e86111e8d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:46.436659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554ea42-0545-442a-8d76-240e86111e8d None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:46.437933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 729/1479] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:34:46.443359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a4cf2-b5b3-401b-b1c4-287640cca8c6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:46.443767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a4cf2-b5b3-401b-b1c4-287640cca8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:46.443907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a4cf2-b5b3-401b-b1c4-287640cca8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:46.509230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-661a4cf2-b5b3-401b-b1c4-287640cca8c6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:46.510425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-661a4cf2-b5b3-401b-b1c4-287640cca8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:46.633922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 751/1480] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:34:47.111301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554ea42-0545-442a-8d76-240e86111e8d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:47.112824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c554ea42-0545-442a-8d76-240e86111e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:47.122470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:47.259187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554ea42-0545-442a-8d76-240e86111e8d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:47.340062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:47.373120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30396ae3-7820-4b7c-a352-67c2de534832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:47.373645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30396ae3-7820-4b7c-a352-67c2de534832 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:47.373927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30396ae3-7820-4b7c-a352-67c2de534832 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:47.374198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30396ae3-7820-4b7c-a352-67c2de534832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:47.375855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-30396ae3-7820-4b7c-a352-67c2de534832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:47.465066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30396ae3-7820-4b7c-a352-67c2de534832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:47.467268 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30396ae3-7820-4b7c-a352-67c2de534832 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:47.485038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 730/1481] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:49.605526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c582-1518-4089-aee9-50488329ad9c None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:49.606085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c582-1518-4089-aee9-50488329ad9c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:49.606085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c582-1518-4089-aee9-50488329ad9c None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:49.607987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 752/1482] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:49.613275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14329625-483a-497f-b6b4-670d4c5aa5c3 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:49.613720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14329625-483a-497f-b6b4-670d4c5aa5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:49.613825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14329625-483a-497f-b6b4-670d4c5aa5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:49.681492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-14329625-483a-497f-b6b4-670d4c5aa5c3 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:49.682775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-14329625-483a-497f-b6b4-670d4c5aa5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:49.730378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:49.780861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 731/1483] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:50.072511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84c582-1518-4089-aee9-50488329ad9c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:50.074050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cd84c582-1518-4089-aee9-50488329ad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:50.098288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:50.179698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84c582-1518-4089-aee9-50488329ad9c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:50.253075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e998f3a-fd1b-4f11-92dd-0923a530df49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:50.253681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e998f3a-fd1b-4f11-92dd-0923a530df49 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:50.253957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e998f3a-fd1b-4f11-92dd-0923a530df49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:50.254226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e998f3a-fd1b-4f11-92dd-0923a530df49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:50.255832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5e998f3a-fd1b-4f11-92dd-0923a530df49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:50.330779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:50.369006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e998f3a-fd1b-4f11-92dd-0923a530df49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:50.370445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e998f3a-fd1b-4f11-92dd-0923a530df49 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:50.387899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 753/1484] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:52.358025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7de20-acad-412d-a50e-61e17682c0ab None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:52.358635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7de20-acad-412d-a50e-61e17682c0ab None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:52.358635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7de20-acad-412d-a50e-61e17682c0ab None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:52.359923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 732/1485] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:52.365358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e65d21-4f78-447d-8f23-6db93e2b7003 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:52.365772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e65d21-4f78-447d-8f23-6db93e2b7003 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:52.365912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e65d21-4f78-447d-8f23-6db93e2b7003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:52.466080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f3e65d21-4f78-447d-8f23-6db93e2b7003 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:52.468565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f3e65d21-4f78-447d-8f23-6db93e2b7003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:52.644166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 754/1486] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:53.125432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7de20-acad-412d-a50e-61e17682c0ab None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:53.127936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e9a7de20-acad-412d-a50e-61e17682c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:53.305404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7de20-acad-412d-a50e-61e17682c0ab None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:53.379888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:53.381600 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbf82e-9a22-48b8-9c6e-f2c32ff7e968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:53.382230 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbf82e-9a22-48b8-9c6e-f2c32ff7e968 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:53.382785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbf82e-9a22-48b8-9c6e-f2c32ff7e968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:53.383174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbf82e-9a22-48b8-9c6e-f2c32ff7e968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:53.385245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b2fbf82e-9a22-48b8-9c6e-f2c32ff7e968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:53.500895 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbf82e-9a22-48b8-9c6e-f2c32ff7e968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:53.502598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbf82e-9a22-48b8-9c6e-f2c32ff7e968 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:53.523276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 733/1487] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:34:55.701203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fad14-c861-4e53-bd39-cdc0d3e949db None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:55.701890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fad14-c861-4e53-bd39-cdc0d3e949db None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:55.701890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fad14-c861-4e53-bd39-cdc0d3e949db None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:55.703042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 755/1488] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:55.708424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ca4c5-918e-455b-b2ba-22a701932a63 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:55.708882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ca4c5-918e-455b-b2ba-22a701932a63 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:55.708991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ca4c5-918e-455b-b2ba-22a701932a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:55.774773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-699ca4c5-918e-455b-b2ba-22a701932a63 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:55.776139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-699ca4c5-918e-455b-b2ba-22a701932a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:55.832339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:55.877869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 734/1489] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:56.176397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fad14-c861-4e53-bd39-cdc0d3e949db None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:56.177916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d69fad14-c861-4e53-bd39-cdc0d3e949db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:56.212944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:56.283539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fad14-c861-4e53-bd39-cdc0d3e949db None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:56.364824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac1e6f-c2ba-4f11-86ce-c11b0bc9d2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:56.365433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac1e6f-c2ba-4f11-86ce-c11b0bc9d2ec service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:56.365715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac1e6f-c2ba-4f11-86ce-c11b0bc9d2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:56.365988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac1e6f-c2ba-4f11-86ce-c11b0bc9d2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:56.367729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c5ac1e6f-c2ba-4f11-86ce-c11b0bc9d2ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:56.488729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:56.519610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac1e6f-c2ba-4f11-86ce-c11b0bc9d2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:56.521055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac1e6f-c2ba-4f11-86ce-c11b0bc9d2ec service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:56.539846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 756/1490] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:34:58.824217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ae0ee-d640-4198-81cf-57a86f354b8d None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:58.824744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ae0ee-d640-4198-81cf-57a86f354b8d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:58.824744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ae0ee-d640-4198-81cf-57a86f354b8d None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:58.826148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 735/1491] 10.222.0.89 () {54 vars in 927 bytes} [Fri Aug 26 15:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:34:58.831658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618d3c9-61ee-43a2-8144-9f1cd02ce012 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:58.832078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618d3c9-61ee-43a2-8144-9f1cd02ce012 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:58.832221 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618d3c9-61ee-43a2-8144-9f1cd02ce012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:58.901836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2618d3c9-61ee-43a2-8144-9f1cd02ce012 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:34:58.903124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2618d3c9-61ee-43a2-8144-9f1cd02ce012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:59.004923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 757/1492] 10.222.0.89 () {58 vars in 1024 bytes} [Fri Aug 26 15:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:34:59.304336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ae0ee-d640-4198-81cf-57a86f354b8d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:34:59.305815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-936ae0ee-d640-4198-81cf-57a86f354b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:59.409197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ae0ee-d640-4198-81cf-57a86f354b8d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:34:59.483804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32340e1-be01-4ee4-bb2e-09292ddf9232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:34:59.484423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32340e1-be01-4ee4-bb2e-09292ddf9232 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:34:59.484698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32340e1-be01-4ee4-bb2e-09292ddf9232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:34:59.484964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32340e1-be01-4ee4-bb2e-09292ddf9232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:34:59.486592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f32340e1-be01-4ee4-bb2e-09292ddf9232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:34:59.495887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:34:59.601762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32340e1-be01-4ee4-bb2e-09292ddf9232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:34:59.603247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32340e1-be01-4ee4-bb2e-09292ddf9232 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:34:59.623462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 736/1493] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:35:09.003179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=82 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:35:09.620782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=50 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:15.635019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd0889-cd9a-4d7a-8c81-c526f72647dd None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:15.635640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd0889-cd9a-4d7a-8c81-c526f72647dd None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:15.635640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd0889-cd9a-4d7a-8c81-c526f72647dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:15.716214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-fdcd0889-cd9a-4d7a-8c81-c526f72647dd None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:15.717432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fdcd0889-cd9a-4d7a-8c81-c526f72647dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:15.819303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 758/1494] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:36:15.828182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35d1bf-5068-4a4b-bcf2-1d6b34c020d0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:15.828742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35d1bf-5068-4a4b-bcf2-1d6b34c020d0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:15.828742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35d1bf-5068-4a4b-bcf2-1d6b34c020d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:15.911002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4c35d1bf-5068-4a4b-bcf2-1d6b34c020d0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:15.912223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4c35d1bf-5068-4a4b-bcf2-1d6b34c020d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:16.007945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 737/1495] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:36:16.012701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd0889-cd9a-4d7a-8c81-c526f72647dd None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:16.013950 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fdcd0889-cd9a-4d7a-8c81-c526f72647dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:16.026011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd0889-cd9a-4d7a-8c81-c526f72647dd None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:16.099420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:16.133476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:16.134092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:16.134375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:16.134647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:16.135331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:36:16.135634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:16.136648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:16.136648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Aug 26 15:36:16.136648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: Aug 26 15:36:16.137552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:16.149514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 759/1496] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:36:16.158506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35d1bf-5068-4a4b-bcf2-1d6b34c020d0 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:16.168099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35d1bf-5068-4a4b-bcf2-1d6b34c020d0 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:16.234782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:16.268786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:16.269385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:16.269692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:16.269956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:16.270585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:16.272471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: WARNING py.warnings [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:16.272471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: warnings.warn(msg) Aug 26 15:36:16.272471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: Aug 26 15:36:16.273558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:16.330422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 738/1497] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:36:16 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:36:16.334768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:16.336349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:16.371715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729b50d-0d1b-46d5-9250-e4b616de1637 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:16.468198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:16.468799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:16.469073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:16.469338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:16.469968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:16.470975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:16.470975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Aug 26 15:36:16.470975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: Aug 26 15:36:16.472175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:16.516598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 760/1498] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:36:16 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:36:16.521122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:16.522659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:16.588649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed22b-44e5-4f6a-afd5-ee2f8cd83da1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:16.674985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:16.686360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:16.687007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:16.687291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:16.687562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:16.688224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:16.689233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: WARNING py.warnings [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:16.689233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: warnings.warn(msg) Aug 26 15:36:16.689233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: Aug 26 15:36:16.690119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:16.703295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 739/1499] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:36:16.707396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:16.708911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:16.720986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f909d-49aa-43f4-821c-ebdb327d7151 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:16.746094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:16.819618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ab5e-be59-439b-9264-a21f9f1d5b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:16.820227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ab5e-be59-439b-9264-a21f9f1d5b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:16.820502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ab5e-be59-439b-9264-a21f9f1d5b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:16.820769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ab5e-be59-439b-9264-a21f9f1d5b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:16.821418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809ab5e-be59-439b-9264-a21f9f1d5b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:16.822425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-f809ab5e-be59-439b-9264-a21f9f1d5b5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:16.822425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Aug 26 15:36:16.822425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: Aug 26 15:36:16.823334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809ab5e-be59-439b-9264-a21f9f1d5b5c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:16.836905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 761/1500] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:36:16.841976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:16.843542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:16.878421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ca248-c7c6-4650-95fa-023e00653910 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:16.982982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d0fa0-95a2-4b7c-b5c0-f5d379aefdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:16.983439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d0fa0-95a2-4b7c-b5c0-f5d379aefdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:16.983726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d0fa0-95a2-4b7c-b5c0-f5d379aefdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:16.983998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d0fa0-95a2-4b7c-b5c0-f5d379aefdf9 admin admin] PATH_INFO: `/v3/projects/7778b045a6a94811be637e12651e1c66/users/156b47195775490ea7674acf44ba3d44/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:17.008907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d0fa0-95a2-4b7c-b5c0-f5d379aefdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7778b045a6a94811be637e12651e1c66, user_id=156b47195775490ea7674acf44ba3d44, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:17.009953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: WARNING py.warnings [None req-007d0fa0-95a2-4b7c-b5c0-f5d379aefdf9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:17.009953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: warnings.warn(msg) Aug 26 15:36:17.009953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: Aug 26 15:36:17.012536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d0fa0-95a2-4b7c-b5c0-f5d379aefdf9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:17.038340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 740/1501] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:36:16 2022] PUT /identity/v3/projects/7778b045a6a94811be637e12651e1c66/users/156b47195775490ea7674acf44ba3d44/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:36:17.052092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a64ff-a06b-4871-9d45-96212ecc04ce None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:17.052403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a64ff-a06b-4871-9d45-96212ecc04ce None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:17.052684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a64ff-a06b-4871-9d45-96212ecc04ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:17.119478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f25a64ff-a06b-4871-9d45-96212ecc04ce None None] MFA Rules not processed for user `156b47195775490ea7674acf44ba3d44`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:17.120729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f25a64ff-a06b-4871-9d45-96212ecc04ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:17.225630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 762/1502] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:36:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:36:17.240725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2181c8-8c6d-419f-bcc8-dc87c83a3f0e None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:17.240958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2181c8-8c6d-419f-bcc8-dc87c83a3f0e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:17.241332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2181c8-8c6d-419f-bcc8-dc87c83a3f0e None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:17.242889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 741/1503] 10.222.0.89 () {54 vars in 964 bytes} [Fri Aug 26 15:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:36:17.250355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705f828-840f-4a1b-b37e-6639a3be593c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:17.250643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705f828-840f-4a1b-b37e-6639a3be593c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:17.250918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705f828-840f-4a1b-b37e-6639a3be593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:17.282877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:17.334241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a705f828-840f-4a1b-b37e-6639a3be593c None None] MFA Rules not processed for user `4a128a6b32fd4a54ad0146551fe77879`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:17.335805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a705f828-840f-4a1b-b37e-6639a3be593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:17.413951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 763/1504] 10.222.0.89 () {58 vars in 1061 bytes} [Fri Aug 26 15:36:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:36:17.422365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2181c8-8c6d-419f-bcc8-dc87c83a3f0e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:17.424024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-dc2181c8-8c6d-419f-bcc8-dc87c83a3f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:17.476479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:17.539300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2181c8-8c6d-419f-bcc8-dc87c83a3f0e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:17.616802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:17.617405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:17.617682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:17.617950 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:17.619704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:17.720180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:17.721688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:17.726079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:17.742476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 742/1505] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:36:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:36:17.788898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273fd4f-4a14-4291-ad41-1bc8d36a2d09 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:17.789372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273fd4f-4a14-4291-ad41-1bc8d36a2d09 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:17.789494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273fd4f-4a14-4291-ad41-1bc8d36a2d09 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:17.790665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 764/1506] 10.222.0.89 () {52 vars in 830 bytes} [Fri Aug 26 15:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:36:17.795164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:17.796412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:17.898419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb27bc-8f12-41f0-9865-a526d9ef74eb service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:18.004339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:18.005236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:18.005638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:18.006032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] PATH_INFO: `/v3/users/156b47195775490ea7674acf44ba3d44` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:18.020697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=156b47195775490ea7674acf44ba3d44)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:18.020989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: WARNING py.warnings [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:18.020989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: warnings.warn(msg) Aug 26 15:36:18.020989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: Aug 26 15:36:18.022224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:18.033803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:18.093151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156b47195775490ea7674acf44ba3d44'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:18.093502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156b47195775490ea7674acf44ba3d44'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:18.118736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156b47195775490ea7674acf44ba3d44'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:18.128451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156b47195775490ea7674acf44ba3d44'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:18.128987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156b47195775490ea7674acf44ba3d44'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:18.148440 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 743/1507] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:36:17 2022] DELETE /identity/v3/users/156b47195775490ea7674acf44ba3d44 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:36:18.152780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d22b02-7e3d-4023-b6f4-c70447d3c3db None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:18.153071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d22b02-7e3d-4023-b6f4-c70447d3c3db None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:18.153381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d22b02-7e3d-4023-b6f4-c70447d3c3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:18.215247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d4d22b02-7e3d-4023-b6f4-c70447d3c3db None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:36:18.216560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d4d22b02-7e3d-4023-b6f4-c70447d3c3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:18.293866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:18.308160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 765/1508] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:36:18.319748 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:18.320983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:18.427264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cee3d5-0602-4405-9f0e-99d2ade6cca0 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:18.492254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:18.513197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a285d4-0b1f-4d72-880e-290251e8666e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:18.513806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a285d4-0b1f-4d72-880e-290251e8666e service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:18.514083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a285d4-0b1f-4d72-880e-290251e8666e service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:18.514353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a285d4-0b1f-4d72-880e-290251e8666e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:18.516129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c7a285d4-0b1f-4d72-880e-290251e8666e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:18.632181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a285d4-0b1f-4d72-880e-290251e8666e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:18.633660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a285d4-0b1f-4d72-880e-290251e8666e service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:18.653002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 744/1509] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:36:18.989639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d22b02-7e3d-4023-b6f4-c70447d3c3db None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:36:18.990865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d4d22b02-7e3d-4023-b6f4-c70447d3c3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:36:19.003053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d22b02-7e3d-4023-b6f4-c70447d3c3db None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:36:19.103091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:36:19.103727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:36:19.104002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:36:19.104295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] PATH_INFO: `/v3/projects/7778b045a6a94811be637e12651e1c66` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:36:19.114662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7778b045a6a94811be637e12651e1c66)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:36:19.115840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:36:19.115840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Aug 26 15:36:19.115840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: Aug 26 15:36:19.117039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:36:19.178490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7778b045a6a94811be637e12651e1c66', 'request_id': 'req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:19.188737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7778b045a6a94811be637e12651e1c66', 'request_id': 'req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:19.200278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7778b045a6a94811be637e12651e1c66', 'request_id': 'req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:19.232289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] The token cache is being invalidate because project 7778b045a6a94811be637e12651e1c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:36:19.232577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:19.233116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-1d48e7e3-7fbe-4c30-a9fd-eedb603dc9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:36:19.234500 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 766/1510] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:36:18 2022] DELETE /identity/v3/projects/7778b045a6a94811be637e12651e1c66 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:36:28.649937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=62 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:36:29.230041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:38:02.030382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974509b-55ab-4cd0-b05b-0244c7bbeab5 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:02.031135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974509b-55ab-4cd0-b05b-0244c7bbeab5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:02.031313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974509b-55ab-4cd0-b05b-0244c7bbeab5 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:02.033578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:38:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:02.043329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ec153-0dd0-4d22-a266-85a3d91ee217 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:02.043976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ec153-0dd0-4d22-a266-85a3d91ee217 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:02.044320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ec153-0dd0-4d22-a266-85a3d91ee217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:02.162789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bb9ec153-0dd0-4d22-a266-85a3d91ee217 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:02.165105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bb9ec153-0dd0-4d22-a266-85a3d91ee217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:02.294663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:02.456036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974509b-55ab-4cd0-b05b-0244c7bbeab5 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:02.458914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1974509b-55ab-4cd0-b05b-0244c7bbeab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:02.635148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974509b-55ab-4cd0-b05b-0244c7bbeab5 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:02.641091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bbb2c-2cdb-4cc7-a847-46b72abc6903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:02.641773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bbb2c-2cdb-4cc7-a847-46b72abc6903 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:02.642098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bbb2c-2cdb-4cc7-a847-46b72abc6903 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:02.642483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bbb2c-2cdb-4cc7-a847-46b72abc6903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:02.653184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bbb2c-2cdb-4cc7-a847-46b72abc6903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:02.654890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bbb2c-2cdb-4cc7-a847-46b72abc6903 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:02.666002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 746/1513] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:03.506958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0f10-1bbe-4a0e-9ed4-092c04e60dd6 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:03.507820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0f10-1bbe-4a0e-9ed4-092c04e60dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:03.507820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0f10-1bbe-4a0e-9ed4-092c04e60dd6 None None] PATH_INFO: `/v3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:03.509467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 768/1514] 10.222.0.93 () {54 vars in 925 bytes} [Fri Aug 26 15:38:03 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:38:03.516822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18c41-070e-4392-aaf1-c039e865067a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:03.517647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18c41-070e-4392-aaf1-c039e865067a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:03.517809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b18c41-070e-4392-aaf1-c039e865067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:03.596277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-a6b18c41-070e-4392-aaf1-c039e865067a None None] MFA Rules not processed for user `8d086e815c1542d1ba9daf81e644166a`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:03.597719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a6b18c41-070e-4392-aaf1-c039e865067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:03.687777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:38:03.695554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 747/1515] 10.222.0.93 () {58 vars in 1015 bytes} [Fri Aug 26 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:38:03.732533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4116-8dd7-4926-9f36-01b3e8c89042 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:03.732861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4116-8dd7-4926-9f36-01b3e8c89042 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:03.733177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b4116-8dd7-4926-9f36-01b3e8c89042 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:03.734622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 769/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:03.740449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3152f-335e-4242-811a-0cd190d05c16 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:03.740787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3152f-335e-4242-811a-0cd190d05c16 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:03.741106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3152f-335e-4242-811a-0cd190d05c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:03.763155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4fd3152f-335e-4242-811a-0cd190d05c16 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:03.764308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4fd3152f-335e-4242-811a-0cd190d05c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:03.773226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 748/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:38:03.935780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4116-8dd7-4926-9f36-01b3e8c89042 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:03.951221 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b4116-8dd7-4926-9f36-01b3e8c89042 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:03.956893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca93d9-889e-4a2c-9882-411ea170a82a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:03.957560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca93d9-889e-4a2c-9882-411ea170a82a service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:03.957887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca93d9-889e-4a2c-9882-411ea170a82a service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:03.958206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca93d9-889e-4a2c-9882-411ea170a82a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:03.967892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca93d9-889e-4a2c-9882-411ea170a82a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:03.969726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca93d9-889e-4a2c-9882-411ea170a82a service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:03.980838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 770/1518] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:38:12.686782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a2a39-bff3-4626-abd1-83d403a580ba None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:12.687436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a2a39-bff3-4626-abd1-83d403a580ba None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:12.687436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a2a39-bff3-4626-abd1-83d403a580ba None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:12.688702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 749/1519] 10.222.0.89 () {54 vars in 961 bytes} [Fri Aug 26 15:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:38:12.695122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c28f83-9e23-4a69-b6ef-ac022ad597aa None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:12.695777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c28f83-9e23-4a69-b6ef-ac022ad597aa None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:12.695777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c28f83-9e23-4a69-b6ef-ac022ad597aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:12.724868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-99c28f83-9e23-4a69-b6ef-ac022ad597aa None None] MFA Rules not processed for user `8d086e815c1542d1ba9daf81e644166a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:12.726627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-99c28f83-9e23-4a69-b6ef-ac022ad597aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:12.738778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 771/1520] 10.222.0.89 () {58 vars in 1058 bytes} [Fri Aug 26 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:12.747448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a2a39-bff3-4626-abd1-83d403a580ba None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:12.764879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a2a39-bff3-4626-abd1-83d403a580ba None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:12.770436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031c037-43c7-40a7-9bd1-39d1c4b99980 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:12.771130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c037-43c7-40a7-9bd1-39d1c4b99980 service placement] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:12.771484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c037-43c7-40a7-9bd1-39d1c4b99980 service placement] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:12.771745 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031c037-43c7-40a7-9bd1-39d1c4b99980 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:12.782138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031c037-43c7-40a7-9bd1-39d1c4b99980 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:12.783832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031c037-43c7-40a7-9bd1-39d1c4b99980 service placement] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:12.794845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 750/1521] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:15.400469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d970b0-6916-4e48-970d-66a8d801e090 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:15.401327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d970b0-6916-4e48-970d-66a8d801e090 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:15.401327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d970b0-6916-4e48-970d-66a8d801e090 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:15.402760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:15.409783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6284a2f-3397-40f1-b7b1-a385cdca8463 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:15.410458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6284a2f-3397-40f1-b7b1-a385cdca8463 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:15.410812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6284a2f-3397-40f1-b7b1-a385cdca8463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:15.445549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c6284a2f-3397-40f1-b7b1-a385cdca8463 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:15.447794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c6284a2f-3397-40f1-b7b1-a385cdca8463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:15.462759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:15.639772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d970b0-6916-4e48-970d-66a8d801e090 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:15.657603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d970b0-6916-4e48-970d-66a8d801e090 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:15.666014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300d5b1-bced-4749-9d0d-fa35d9ce5f74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:15.667198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d5b1-bced-4749-9d0d-fa35d9ce5f74 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:15.667707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d5b1-bced-4749-9d0d-fa35d9ce5f74 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:15.668188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d5b1-bced-4749-9d0d-fa35d9ce5f74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:15.684122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d5b1-bced-4749-9d0d-fa35d9ce5f74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:15.687206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d5b1-bced-4749-9d0d-fa35d9ce5f74 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:15.702411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 773/1524] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:16.653967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584545c4-1d83-4f22-bf94-4ef663c8ab24 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:16.654631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584545c4-1d83-4f22-bf94-4ef663c8ab24 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:16.654826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584545c4-1d83-4f22-bf94-4ef663c8ab24 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:16.657150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 15:38:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:16.664765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c459137-b96d-468f-bab4-892f94d25f47 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:16.665626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c459137-b96d-468f-bab4-892f94d25f47 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:16.665626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c459137-b96d-468f-bab4-892f94d25f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:16.689306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7c459137-b96d-468f-bab4-892f94d25f47 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:16.690667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7c459137-b96d-468f-bab4-892f94d25f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:16.699899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:16.872592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584545c4-1d83-4f22-bf94-4ef663c8ab24 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:16.889739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584545c4-1d83-4f22-bf94-4ef663c8ab24 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:16.896558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992dcd5-82cc-4fbc-ac2b-f413e0d38842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:16.897344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992dcd5-82cc-4fbc-ac2b-f413e0d38842 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:16.897720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992dcd5-82cc-4fbc-ac2b-f413e0d38842 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:16.898095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992dcd5-82cc-4fbc-ac2b-f413e0d38842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:16.908931 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992dcd5-82cc-4fbc-ac2b-f413e0d38842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:16.910617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992dcd5-82cc-4fbc-ac2b-f413e0d38842 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:16.922071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 753/1527] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:38:21.903365 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3d7d9-1c90-48eb-9263-c8fa094f2aab None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:21.904232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3d7d9-1c90-48eb-9263-c8fa094f2aab None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:21.904410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3d7d9-1c90-48eb-9263-c8fa094f2aab None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:21.907601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:38:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:21.916564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195638-2ac4-4f66-9d71-edad3d1e2fd5 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:21.917268 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195638-2ac4-4f66-9d71-edad3d1e2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:21.917579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195638-2ac4-4f66-9d71-edad3d1e2fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:21.945461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-3d195638-2ac4-4f66-9d71-edad3d1e2fd5 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:21.946692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3d195638-2ac4-4f66-9d71-edad3d1e2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:21.956018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:22.255991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3d7d9-1c90-48eb-9263-c8fa094f2aab None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:22.257916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bee3d7d9-1c90-48eb-9263-c8fa094f2aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:22.299063 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:38:22.356046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3d7d9-1c90-48eb-9263-c8fa094f2aab None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:22.360316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b3cb9-d468-4457-9c13-1dee2ba282ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:22.361197 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b3cb9-d468-4457-9c13-1dee2ba282ab service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:22.361593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b3cb9-d468-4457-9c13-1dee2ba282ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:22.361961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b3cb9-d468-4457-9c13-1dee2ba282ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:22.374140 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b3cb9-d468-4457-9c13-1dee2ba282ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:22.375781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b3cb9-d468-4457-9c13-1dee2ba282ab service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:22.387740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 776/1530] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:38:24.758316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768f624-6052-46b6-b891-9139b728ccd5 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:24.759135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768f624-6052-46b6-b891-9139b728ccd5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:24.759135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768f624-6052-46b6-b891-9139b728ccd5 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:24.760271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:38:24.771313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b73dcd-0435-4401-a792-9053626be6e1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:24.771923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b73dcd-0435-4401-a792-9053626be6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:24.772285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b73dcd-0435-4401-a792-9053626be6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:24.807609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-84b73dcd-0435-4401-a792-9053626be6e1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:24.809800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-84b73dcd-0435-4401-a792-9053626be6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:24.825024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:25.144745 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768f624-6052-46b6-b891-9139b728ccd5 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:25.147604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6768f624-6052-46b6-b891-9139b728ccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:25.171023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768f624-6052-46b6-b891-9139b728ccd5 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:25.176875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97733ac-bf64-4073-b62a-9b82bf743ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:25.177985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97733ac-bf64-4073-b62a-9b82bf743ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:25.178485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97733ac-bf64-4073-b62a-9b82bf743ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:25.178773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97733ac-bf64-4073-b62a-9b82bf743ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:25.190370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97733ac-bf64-4073-b62a-9b82bf743ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:25.191852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97733ac-bf64-4073-b62a-9b82bf743ad5 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:25.202203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 756/1533] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:29.419115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dcdf5-ac4a-407a-8ff8-f6c0796c2eda None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:29.419662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dcdf5-ac4a-407a-8ff8-f6c0796c2eda None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:29.419662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dcdf5-ac4a-407a-8ff8-f6c0796c2eda None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:29.421015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:29.427813 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da739453-bf81-456c-adc7-e4225e6f6438 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:29.429544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da739453-bf81-456c-adc7-e4225e6f6438 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:29.429544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da739453-bf81-456c-adc7-e4225e6f6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:29.454482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-da739453-bf81-456c-adc7-e4225e6f6438 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:29.455806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-da739453-bf81-456c-adc7-e4225e6f6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:29.464349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:30.054843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dcdf5-ac4a-407a-8ff8-f6c0796c2eda None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:30.058299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-259dcdf5-ac4a-407a-8ff8-f6c0796c2eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:30.206919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dcdf5-ac4a-407a-8ff8-f6c0796c2eda None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:30.211846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e1bc-4a2b-4904-9b8e-5f80ac954531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:30.212561 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e1bc-4a2b-4904-9b8e-5f80ac954531 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:30.212873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e1bc-4a2b-4904-9b8e-5f80ac954531 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:30.213186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e1bc-4a2b-4904-9b8e-5f80ac954531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:30.225498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879e1bc-4a2b-4904-9b8e-5f80ac954531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:30.228585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879e1bc-4a2b-4904-9b8e-5f80ac954531 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:30.249515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 779/1536] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:38:33.347383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97743da5-363a-453e-8a9c-c720e444cf58 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:33.348190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97743da5-363a-453e-8a9c-c720e444cf58 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:33.348190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97743da5-363a-453e-8a9c-c720e444cf58 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:33.349316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 15:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:38:33.355999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d961-59e8-4c04-88c0-8aec3f622304 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:33.356801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d961-59e8-4c04-88c0-8aec3f622304 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:33.356801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242d961-59e8-4c04-88c0-8aec3f622304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:33.381402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d242d961-59e8-4c04-88c0-8aec3f622304 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:38:33.382761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d242d961-59e8-4c04-88c0-8aec3f622304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:33.391742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:38:34.002742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97743da5-363a-453e-8a9c-c720e444cf58 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:38:34.004723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-97743da5-363a-453e-8a9c-c720e444cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:38:34.017242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=32 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:38:34.025264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97743da5-363a-453e-8a9c-c720e444cf58 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:38:34.030342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308eead-607d-4e4a-966b-4ef0fdce722f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:38:34.031122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308eead-607d-4e4a-966b-4ef0fdce722f service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:38:34.031454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308eead-607d-4e4a-966b-4ef0fdce722f service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:38:34.031780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308eead-607d-4e4a-966b-4ef0fdce722f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:38:34.047272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308eead-607d-4e4a-966b-4ef0fdce722f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:38:34.049098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308eead-607d-4e4a-966b-4ef0fdce722f service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:38:34.064513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 759/1539] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:38:43.374412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=63 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:38:44.057248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:13.401060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf8f9f-fdf9-4e1d-857b-cbc077b24238 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.402042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf8f9f-fdf9-4e1d-857b-cbc077b24238 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.402042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf8f9f-fdf9-4e1d-857b-cbc077b24238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.440092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467a31-ade3-4d70-97ae-7532d9283aae None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.441649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467a31-ade3-4d70-97ae-7532d9283aae None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.442438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467a31-ade3-4d70-97ae-7532d9283aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.456907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-31cf8f9f-fdf9-4e1d-857b-cbc077b24238 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:13.458986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-31cf8f9f-fdf9-4e1d-857b-cbc077b24238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.480079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 781/1540] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:13.492679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-bb467a31-ade3-4d70-97ae-7532d9283aae None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:13.494432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bb467a31-ade3-4d70-97ae-7532d9283aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.505715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216463-3a90-4c0c-a598-b5ee2ac3b5c7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.506263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216463-3a90-4c0c-a598-b5ee2ac3b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.506765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69216463-3a90-4c0c-a598-b5ee2ac3b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.508363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 760/1541] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:13.517557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e360b83-676f-4d57-abf3-36c15d5e6a7c None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.518173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e360b83-676f-4d57-abf3-36c15d5e6a7c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.518720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e360b83-676f-4d57-abf3-36c15d5e6a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.560057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4e360b83-676f-4d57-abf3-36c15d5e6a7c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:13.561674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4e360b83-676f-4d57-abf3-36c15d5e6a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.565848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-69216463-3a90-4c0c-a598-b5ee2ac3b5c7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:13.568394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-69216463-3a90-4c0c-a598-b5ee2ac3b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.577735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 761/1542] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:13.583111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e360b83-676f-4d57-abf3-36c15d5e6a7c None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:13.595832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 782/1543] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:13.602243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e360b83-676f-4d57-abf3-36c15d5e6a7c None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:13.606976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69216463-3a90-4c0c-a598-b5ee2ac3b5c7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:13.617517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:13.618558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.619074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.619577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.621244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:13.621792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:13.627455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69216463-3a90-4c0c-a598-b5ee2ac3b5c7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:13.635261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: WARNING py.warnings [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:40:13.635261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: warnings.warn(msg) Aug 26 15:40:13.635261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: Aug 26 15:40:13.636333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:13.646043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf89c-95bf-4901-af74-e9f1a3f1aa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:13.649159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf89c-95bf-4901-af74-e9f1a3f1aa54 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.649159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf89c-95bf-4901-af74-e9f1a3f1aa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.649159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf89c-95bf-4901-af74-e9f1a3f1aa54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.649704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bf89c-95bf-4901-af74-e9f1a3f1aa54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:13.650258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bf89c-95bf-4901-af74-e9f1a3f1aa54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:13.653598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bf89c-95bf-4901-af74-e9f1a3f1aa54 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:13.662164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 762/1544] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:40:13.670992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:13.690809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 783/1545] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:40:13.693713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b96cf-c35c-4abd-b060-ad4f2bc07c42 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:13.707560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1d2fa-6661-4be1-b005-705234da99ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:13.708537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1d2fa-6661-4be1-b005-705234da99ca admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.708781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf89c-95bf-4901-af74-e9f1a3f1aa54 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:13.709178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1d2fa-6661-4be1-b005-705234da99ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.709624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1d2fa-6661-4be1-b005-705234da99ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.710437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1d2fa-6661-4be1-b005-705234da99ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:13.712870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1d2fa-6661-4be1-b005-705234da99ca admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:13.734278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf89c-95bf-4901-af74-e9f1a3f1aa54 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:13.750006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400e614-14e3-4ff7-8cca-ac33fccd2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:13.751128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400e614-14e3-4ff7-8cca-ac33fccd2079 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.751787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400e614-14e3-4ff7-8cca-ac33fccd2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.752130 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400e614-14e3-4ff7-8cca-ac33fccd2079 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.753337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400e614-14e3-4ff7-8cca-ac33fccd2079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:13.755646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-e400e614-14e3-4ff7-8cca-ac33fccd2079 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:40:13.755646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Aug 26 15:40:13.755646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: Aug 26 15:40:13.759026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400e614-14e3-4ff7-8cca-ac33fccd2079 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:13.809814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 763/1546] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:13.811428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d56b2-647f-422c-bbe7-f7d2604d947f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:13.811900 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d56b2-647f-422c-bbe7-f7d2604d947f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:13.816503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d56b2-647f-422c-bbe7-f7d2604d947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:13.858283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 784/1547] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/projects => generated 393 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:13.858283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400e614-14e3-4ff7-8cca-ac33fccd2079 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:13.879651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1e3d56b2-647f-422c-bbe7-f7d2604d947f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:13.881305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1e3d56b2-647f-422c-bbe7-f7d2604d947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:13.988939 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 764/1548] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:13.990649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d56b2-647f-422c-bbe7-f7d2604d947f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.003369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d56b2-647f-422c-bbe7-f7d2604d947f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.013224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400e614-14e3-4ff7-8cca-ac33fccd2079 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.019560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c99b27-fd29-4649-b327-32906b0b67cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.021176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c99b27-fd29-4649-b327-32906b0b67cd admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.022178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c99b27-fd29-4649-b327-32906b0b67cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.023684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c99b27-fd29-4649-b327-32906b0b67cd admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.024559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c99b27-fd29-4649-b327-32906b0b67cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.027085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: WARNING py.warnings [None req-60c99b27-fd29-4649-b327-32906b0b67cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:40:14.027085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: warnings.warn(msg) Aug 26 15:40:14.027085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: Aug 26 15:40:14.028128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c6693-4474-495c-ad36-e6ec9893929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.029609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c99b27-fd29-4649-b327-32906b0b67cd admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.030417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c6693-4474-495c-ad36-e6ec9893929e admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.030855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c6693-4474-495c-ad36-e6ec9893929e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.031311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c6693-4474-495c-ad36-e6ec9893929e admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.032105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c6693-4474-495c-ad36-e6ec9893929e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.041898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c6693-4474-495c-ad36-e6ec9893929e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.099698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 785/1549] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/users => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:14.100627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 765/1550] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:13 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:14.101957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4423b-20bc-435b-8a3f-f2d8a80c55bc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.102330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d8bf7-9f7d-4595-80ab-3d33f6dea946 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.102613 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4423b-20bc-435b-8a3f-f2d8a80c55bc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.102817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d8bf7-9f7d-4595-80ab-3d33f6dea946 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.105998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d8bf7-9f7d-4595-80ab-3d33f6dea946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.106571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4423b-20bc-435b-8a3f-f2d8a80c55bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.141457 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ff4d8bf7-9f7d-4595-80ab-3d33f6dea946 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.142926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ff4d8bf7-9f7d-4595-80ab-3d33f6dea946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.146959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-88f4423b-20bc-435b-8a3f-f2d8a80c55bc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.150704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-88f4423b-20bc-435b-8a3f-f2d8a80c55bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.159201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 766/1551] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.161264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd63a0-b6ea-4d7e-aea3-eb4853e0b10b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.161558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd63a0-b6ea-4d7e-aea3-eb4853e0b10b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.162388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd63a0-b6ea-4d7e-aea3-eb4853e0b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.171466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 786/1552] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.172337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4423b-20bc-435b-8a3f-f2d8a80c55bc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.199254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4423b-20bc-435b-8a3f-f2d8a80c55bc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.210215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b9dd63a0-b6ea-4d7e-aea3-eb4853e0b10b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.211527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b9dd63a0-b6ea-4d7e-aea3-eb4853e0b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.213088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a4bc2-bc30-494d-8079-c32c8d6adcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.214272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a4bc2-bc30-494d-8079-c32c8d6adcfb admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.214557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a4bc2-bc30-494d-8079-c32c8d6adcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.214832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a4bc2-bc30-494d-8079-c32c8d6adcfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.215677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a4bc2-bc30-494d-8079-c32c8d6adcfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.217321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a4bc2-bc30-494d-8079-c32c8d6adcfb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.232133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 767/1553] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.233004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd63a0-b6ea-4d7e-aea3-eb4853e0b10b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.245784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 787/1554] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:14.246645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a4bc2-bc30-494d-8079-c32c8d6adcfb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.258358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd63a0-b6ea-4d7e-aea3-eb4853e0b10b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.271460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc0d73-3bae-492a-8fd0-fd9209377942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.271769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a4bc2-bc30-494d-8079-c32c8d6adcfb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.273100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0d73-3bae-492a-8fd0-fd9209377942 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.273477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0d73-3bae-492a-8fd0-fd9209377942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.273750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0d73-3bae-492a-8fd0-fd9209377942 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.274436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc0d73-3bae-492a-8fd0-fd9209377942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.277553 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc0d73-3bae-492a-8fd0-fd9209377942 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.288481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931802-3858-4f67-a331-186055b50f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.289115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931802-3858-4f67-a331-186055b50f27 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.289397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931802-3858-4f67-a331-186055b50f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.289824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931802-3858-4f67-a331-186055b50f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.290505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931802-3858-4f67-a331-186055b50f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:14.290811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931802-3858-4f67-a331-186055b50f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.293132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931802-3858-4f67-a331-186055b50f27 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.299029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 768/1555] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:14.301473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf232c3d-2cb6-46cf-b09a-3da2b75eef33 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.301983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf232c3d-2cb6-46cf-b09a-3da2b75eef33 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.302477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf232c3d-2cb6-46cf-b09a-3da2b75eef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.309402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 788/1556] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:14.310597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931802-3858-4f67-a331-186055b50f27 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.333049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931802-3858-4f67-a331-186055b50f27 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.345303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-cf232c3d-2cb6-46cf-b09a-3da2b75eef33 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.346537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-cf232c3d-2cb6-46cf-b09a-3da2b75eef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.347468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4cf6b-51a5-4d9d-89c7-24a20a18095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.348589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cf6b-51a5-4d9d-89c7-24a20a18095c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.349075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cf6b-51a5-4d9d-89c7-24a20a18095c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.349604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4cf6b-51a5-4d9d-89c7-24a20a18095c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.350466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cf6b-51a5-4d9d-89c7-24a20a18095c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.352659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4cf6b-51a5-4d9d-89c7-24a20a18095c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.358985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 769/1557] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.358985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1c82-bb3e-4397-a436-f2a47bbd1647 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.358985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1c82-bb3e-4397-a436-f2a47bbd1647 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.358985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1c82-bb3e-4397-a436-f2a47bbd1647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.372012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 789/1558] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:14.374010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0a7a9-e3d5-4b3f-a43c-b7ccd60aa7e0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.374507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0a7a9-e3d5-4b3f-a43c-b7ccd60aa7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.375021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0a7a9-e3d5-4b3f-a43c-b7ccd60aa7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.378626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-71af1c82-bb3e-4397-a436-f2a47bbd1647 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.379888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-71af1c82-bb3e-4397-a436-f2a47bbd1647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.388989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 770/1559] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.389813 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1c82-bb3e-4397-a436-f2a47bbd1647 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.399623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1c82-bb3e-4397-a436-f2a47bbd1647 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.404327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0f87f-4f6b-4dc1-b50e-51a60833ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.404939 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0f87f-4f6b-4dc1-b50e-51a60833ba7c admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.405222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0f87f-4f6b-4dc1-b50e-51a60833ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.405507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0f87f-4f6b-4dc1-b50e-51a60833ba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.406157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0f87f-4f6b-4dc1-b50e-51a60833ba7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.407577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f5f0a7a9-e3d5-4b3f-a43c-b7ccd60aa7e0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.408046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0f87f-4f6b-4dc1-b50e-51a60833ba7c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.409627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f5f0a7a9-e3d5-4b3f-a43c-b7ccd60aa7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.419224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 771/1560] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:14.419781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0f87f-4f6b-4dc1-b50e-51a60833ba7c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.423789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 790/1561] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.425902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efe59-3c40-4545-b1ec-0a191d1d4568 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.426402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efe59-3c40-4545-b1ec-0a191d1d4568 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.426892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efe59-3c40-4545-b1ec-0a191d1d4568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.431990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0f87f-4f6b-4dc1-b50e-51a60833ba7c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.437155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd896d00-30f6-4a18-bd6a-12aabbf6ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.437766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd896d00-30f6-4a18-bd6a-12aabbf6ac53 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.438047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd896d00-30f6-4a18-bd6a-12aabbf6ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.438323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd896d00-30f6-4a18-bd6a-12aabbf6ac53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.438982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd896d00-30f6-4a18-bd6a-12aabbf6ac53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.440884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd896d00-30f6-4a18-bd6a-12aabbf6ac53 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.459083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-834efe59-3c40-4545-b1ec-0a191d1d4568 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.461170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-834efe59-3c40-4545-b1ec-0a191d1d4568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.469965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 772/1562] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:14.471261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5cef1-e6a0-4a61-9b7d-79d4cc57f08f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.471546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5cef1-e6a0-4a61-9b7d-79d4cc57f08f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.471841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5cef1-e6a0-4a61-9b7d-79d4cc57f08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.475342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 791/1563] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.477274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834efe59-3c40-4545-b1ec-0a191d1d4568 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.494101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834efe59-3c40-4545-b1ec-0a191d1d4568 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.498809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-85f5cef1-e6a0-4a61-9b7d-79d4cc57f08f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.499995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-85f5cef1-e6a0-4a61-9b7d-79d4cc57f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.511110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:14.559592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:14.565902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 773/1564] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.566844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5cef1-e6a0-4a61-9b7d-79d4cc57f08f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.577957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5cef1-e6a0-4a61-9b7d-79d4cc57f08f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.581466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6152d-d844-430d-9548-0a01dee163e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.582120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6152d-d844-430d-9548-0a01dee163e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.582407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6152d-d844-430d-9548-0a01dee163e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.582676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6152d-d844-430d-9548-0a01dee163e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.583385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6152d-d844-430d-9548-0a01dee163e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:14.583582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea8440-8139-4e89-9839-8cda0391c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.583712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6152d-d844-430d-9548-0a01dee163e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.584273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea8440-8139-4e89-9839-8cda0391c387 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.584556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea8440-8139-4e89-9839-8cda0391c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.584848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea8440-8139-4e89-9839-8cda0391c387 admin admin] PATH_INFO: `/v3/projects/c056fa5edd894345abe568a8f242bbcb/users/b9d3c73a95ae42c6ad6129b5c760190d/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.585322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6152d-d844-430d-9548-0a01dee163e1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.598617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 792/1565] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:14.599393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6152d-d844-430d-9548-0a01dee163e1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.602521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea8440-8139-4e89-9839-8cda0391c387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c056fa5edd894345abe568a8f242bbcb, user_id=b9d3c73a95ae42c6ad6129b5c760190d, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.605718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea8440-8139-4e89-9839-8cda0391c387 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.611017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6152d-d844-430d-9548-0a01dee163e1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.616550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcfe7e-4530-496c-8942-7b1933277d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.617265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcfe7e-4530-496c-8942-7b1933277d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.617652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcfe7e-4530-496c-8942-7b1933277d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.618006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcfe7e-4530-496c-8942-7b1933277d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.618701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcfe7e-4530-496c-8942-7b1933277d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:14.619047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcfe7e-4530-496c-8942-7b1933277d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.622328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcfe7e-4530-496c-8942-7b1933277d71 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.626565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 774/1566] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:14 2022] PUT /identity/v3/projects/c056fa5edd894345abe568a8f242bbcb/users/b9d3c73a95ae42c6ad6129b5c760190d/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:14.628151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea8440-8139-4e89-9839-8cda0391c387 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.643721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 793/1567] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:14.649392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ed0d-9617-41ae-9e88-9054ccf3b4d9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.649906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ed0d-9617-41ae-9e88-9054ccf3b4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.650395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ed0d-9617-41ae-9e88-9054ccf3b4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.680475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d062ed0d-9617-41ae-9e88-9054ccf3b4d9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.681744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d062ed0d-9617-41ae-9e88-9054ccf3b4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.701941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea8440-8139-4e89-9839-8cda0391c387 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.706779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e05c2c-9e0d-429d-8e8d-cae65abca6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.707661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05c2c-9e0d-429d-8e8d-cae65abca6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.707790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05c2c-9e0d-429d-8e8d-cae65abca6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.708031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05c2c-9e0d-429d-8e8d-cae65abca6b8 admin admin] PATH_INFO: `/v3/projects/293d131d2aff448eb7d28660c2884bcc/users/66a5f1265c2f44fbb9a58d8d163b8460/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.730539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e05c2c-9e0d-429d-8e8d-cae65abca6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293d131d2aff448eb7d28660c2884bcc, user_id=66a5f1265c2f44fbb9a58d8d163b8460, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.735218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e05c2c-9e0d-429d-8e8d-cae65abca6b8 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.761434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 775/1568] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:14 2022] PUT /identity/v3/projects/293d131d2aff448eb7d28660c2884bcc/users/66a5f1265c2f44fbb9a58d8d163b8460/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:14.763027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e05c2c-9e0d-429d-8e8d-cae65abca6b8 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.776653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 794/1569] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.778391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ce72-8c3a-4a07-bb19-aabbfdbdbfbc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.778688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ce72-8c3a-4a07-bb19-aabbfdbdbfbc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.778988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ce72-8c3a-4a07-bb19-aabbfdbdbfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.819333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6c74ce72-8c3a-4a07-bb19-aabbfdbdbfbc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.820917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6c74ce72-8c3a-4a07-bb19-aabbfdbdbfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.868673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e05c2c-9e0d-429d-8e8d-cae65abca6b8 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.874372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc7895-a004-4c00-bd3c-01626ede6eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.875030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc7895-a004-4c00-bd3c-01626ede6eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.875315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc7895-a004-4c00-bd3c-01626ede6eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.875594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc7895-a004-4c00-bd3c-01626ede6eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.876403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc7895-a004-4c00-bd3c-01626ede6eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.878367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc7895-a004-4c00-bd3c-01626ede6eb2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.910156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 776/1570] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:14.910156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0cf9-168d-4d3d-aecb-d7e548cfeda0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.910156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0cf9-168d-4d3d-aecb-d7e548cfeda0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.910156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b0cf9-168d-4d3d-aecb-d7e548cfeda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.919188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 795/1571] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.924198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ce72-8c3a-4a07-bb19-aabbfdbdbfbc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:14.926559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:14.946563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ce72-8c3a-4a07-bb19-aabbfdbdbfbc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:14.950407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-a18b0cf9-168d-4d3d-aecb-d7e548cfeda0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:14.952647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a18b0cf9-168d-4d3d-aecb-d7e548cfeda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:14.953461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db569c9c-a264-4b49-93bc-a6e99c01e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:14.954103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db569c9c-a264-4b49-93bc-a6e99c01e5be admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.954363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db569c9c-a264-4b49-93bc-a6e99c01e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.954649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db569c9c-a264-4b49-93bc-a6e99c01e5be admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:14.955432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db569c9c-a264-4b49-93bc-a6e99c01e5be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:14.957462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db569c9c-a264-4b49-93bc-a6e99c01e5be admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:14.971971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 777/1572] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:14.971971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0c04-f704-4720-b0fa-40ff6c7120cc None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:14.971971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0c04-f704-4720-b0fa-40ff6c7120cc None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:14.971971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0c04-f704-4720-b0fa-40ff6c7120cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.005460 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 796/1573] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.005460 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db569c9c-a264-4b49-93bc-a6e99c01e5be admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.025286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-89da0c04-f704-4720-b0fa-40ff6c7120cc None None] MFA Rules not processed for user `b9d3c73a95ae42c6ad6129b5c760190d`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:15.026635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-89da0c04-f704-4720-b0fa-40ff6c7120cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:15.076443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:15.099366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db569c9c-a264-4b49-93bc-a6e99c01e5be admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.106360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c925f-ccdc-4adc-ae43-d68b43d9c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.107137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c925f-ccdc-4adc-ae43-d68b43d9c627 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.107416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c925f-ccdc-4adc-ae43-d68b43d9c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.107692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c925f-ccdc-4adc-ae43-d68b43d9c627 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.108340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c925f-ccdc-4adc-ae43-d68b43d9c627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.110281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c925f-ccdc-4adc-ae43-d68b43d9c627 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.130459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 778/1574] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:15.130459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ee089-1247-4394-a46c-679850937fbd None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.130459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ee089-1247-4394-a46c-679850937fbd None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.130459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ee089-1247-4394-a46c-679850937fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.154081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ca5ee089-1247-4394-a46c-679850937fbd None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:15.155686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ca5ee089-1247-4394-a46c-679850937fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:15.157537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 797/1575] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.158843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c925f-ccdc-4adc-ae43-d68b43d9c627 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.242086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c925f-ccdc-4adc-ae43-d68b43d9c627 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.248126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad034-8e30-48ae-8ecf-fc2743258ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.248766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad034-8e30-48ae-8ecf-fc2743258ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.249051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad034-8e30-48ae-8ecf-fc2743258ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.249326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ad034-8e30-48ae-8ecf-fc2743258ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.250147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad034-8e30-48ae-8ecf-fc2743258ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:15.250457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad034-8e30-48ae-8ecf-fc2743258ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.252141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ad034-8e30-48ae-8ecf-fc2743258ac4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.263215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 779/1576] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:15.265551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ee089-1247-4394-a46c-679850937fbd None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.279069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 798/1577] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:15.279069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad034-8e30-48ae-8ecf-fc2743258ac4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.286080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ad034-8e30-48ae-8ecf-fc2743258ac4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.286832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ee089-1247-4394-a46c-679850937fbd None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.293552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1119-d2b5-4d2b-b8f9-de1b779b9f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.294267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1119-d2b5-4d2b-b8f9-de1b779b9f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.294511 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83b58-1f10-4b0f-975b-a33cd51b2f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.295413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1119-d2b5-4d2b-b8f9-de1b779b9f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.295413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c1119-d2b5-4d2b-b8f9-de1b779b9f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.295593 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83b58-1f10-4b0f-975b-a33cd51b2f41 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.295593 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83b58-1f10-4b0f-975b-a33cd51b2f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.295767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83b58-1f10-4b0f-975b-a33cd51b2f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.295868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c1119-d2b5-4d2b-b8f9-de1b779b9f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:15.296234 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c1119-d2b5-4d2b-b8f9-de1b779b9f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.296457 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b83b58-1f10-4b0f-975b-a33cd51b2f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.297980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c1119-d2b5-4d2b-b8f9-de1b779b9f8f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.298107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b83b58-1f10-4b0f-975b-a33cd51b2f41 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.313161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 799/1578] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:15.314097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1119-d2b5-4d2b-b8f9-de1b779b9f8f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.317456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 780/1579] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:15.317456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83b58-1f10-4b0f-975b-a33cd51b2f41 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.327192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83b58-1f10-4b0f-975b-a33cd51b2f41 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.331558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c1119-d2b5-4d2b-b8f9-de1b779b9f8f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.333344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec029b-e951-4903-b44f-c2aa06b326ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.334378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec029b-e951-4903-b44f-c2aa06b326ce admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.334378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec029b-e951-4903-b44f-c2aa06b326ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.334605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec029b-e951-4903-b44f-c2aa06b326ce admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.335332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec029b-e951-4903-b44f-c2aa06b326ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.336787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ecdd5-8018-4742-8d70-780ff8e7dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.337289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec029b-e951-4903-b44f-c2aa06b326ce admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.337408 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ecdd5-8018-4742-8d70-780ff8e7dc1a admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.337679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ecdd5-8018-4742-8d70-780ff8e7dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.337913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ecdd5-8018-4742-8d70-780ff8e7dc1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.339130 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ecdd5-8018-4742-8d70-780ff8e7dc1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:15.339445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ecdd5-8018-4742-8d70-780ff8e7dc1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.341047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ecdd5-8018-4742-8d70-780ff8e7dc1a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.355864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 800/1580] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:15.356381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ecdd5-8018-4742-8d70-780ff8e7dc1a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.369366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ecdd5-8018-4742-8d70-780ff8e7dc1a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.376072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 781/1581] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.376072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec029b-e951-4903-b44f-c2aa06b326ce admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.379313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79479e-3ffc-46cf-aba1-c013c888e29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.380332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79479e-3ffc-46cf-aba1-c013c888e29c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.380855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79479e-3ffc-46cf-aba1-c013c888e29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.381363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79479e-3ffc-46cf-aba1-c013c888e29c admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.382508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79479e-3ffc-46cf-aba1-c013c888e29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.386083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79479e-3ffc-46cf-aba1-c013c888e29c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.392264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec029b-e951-4903-b44f-c2aa06b326ce admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.399540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23791b-b239-4b1a-a5f4-2104c6ba5169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.400308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23791b-b239-4b1a-a5f4-2104c6ba5169 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.400691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23791b-b239-4b1a-a5f4-2104c6ba5169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.401700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23791b-b239-4b1a-a5f4-2104c6ba5169 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.402664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23791b-b239-4b1a-a5f4-2104c6ba5169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.404990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23791b-b239-4b1a-a5f4-2104c6ba5169 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.431391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 801/1582] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/projects => generated 405 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.433333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79479e-3ffc-46cf-aba1-c013c888e29c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.441053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 782/1583] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/users => generated 288 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.442795 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23791b-b239-4b1a-a5f4-2104c6ba5169 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.456234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23791b-b239-4b1a-a5f4-2104c6ba5169 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.505591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79479e-3ffc-46cf-aba1-c013c888e29c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.510484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b9c28-0dd7-4193-922e-9b99d3870b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.511134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b9c28-0dd7-4193-922e-9b99d3870b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.511414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b9c28-0dd7-4193-922e-9b99d3870b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.511686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b9c28-0dd7-4193-922e-9b99d3870b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.517987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:15.546146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:15.548440 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e26ec4-c25a-448b-96f1-6899a9db5576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.549141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e26ec4-c25a-448b-96f1-6899a9db5576 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.549421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e26ec4-c25a-448b-96f1-6899a9db5576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.549706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e26ec4-c25a-448b-96f1-6899a9db5576 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.550335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e26ec4-c25a-448b-96f1-6899a9db5576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.552324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e26ec4-c25a-448b-96f1-6899a9db5576 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.585218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b9c28-0dd7-4193-922e-9b99d3870b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.585539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 783/1584] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.586410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e26ec4-c25a-448b-96f1-6899a9db5576 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.589043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b9c28-0dd7-4193-922e-9b99d3870b2d service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.607141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 802/1585] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:15.608374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b9c28-0dd7-4193-922e-9b99d3870b2d service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.623229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b9c28-0dd7-4193-922e-9b99d3870b2d service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.674302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e26ec4-c25a-448b-96f1-6899a9db5576 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.681586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b966-315a-4abe-a518-258f04a6b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.683182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b966-315a-4abe-a518-258f04a6b0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.683357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b966-315a-4abe-a518-258f04a6b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.683912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6b966-315a-4abe-a518-258f04a6b0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.685207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b966-315a-4abe-a518-258f04a6b0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.687122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6b966-315a-4abe-a518-258f04a6b0e4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.711463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 784/1586] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:15.711463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b966-315a-4abe-a518-258f04a6b0e4 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.733666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6b966-315a-4abe-a518-258f04a6b0e4 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.744012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeca04-8ce2-4e3d-8780-a109f4a53f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.744397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adef4c-41b4-42e5-a4d8-2aa4fbdbeded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.745137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adef4c-41b4-42e5-a4d8-2aa4fbdbeded admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.745468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adef4c-41b4-42e5-a4d8-2aa4fbdbeded admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.745692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeca04-8ce2-4e3d-8780-a109f4a53f82 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.745872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08adef4c-41b4-42e5-a4d8-2aa4fbdbeded admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.746381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeca04-8ce2-4e3d-8780-a109f4a53f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.746799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adef4c-41b4-42e5-a4d8-2aa4fbdbeded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.747056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbeca04-8ce2-4e3d-8780-a109f4a53f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.748321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbeca04-8ce2-4e3d-8780-a109f4a53f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.749208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08adef4c-41b4-42e5-a4d8-2aa4fbdbeded admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.751953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbeca04-8ce2-4e3d-8780-a109f4a53f82 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.797167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 803/1587] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.798856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adef4c-41b4-42e5-a4d8-2aa4fbdbeded admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.810179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 785/1588] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.811786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeca04-8ce2-4e3d-8780-a109f4a53f82 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.926655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08adef4c-41b4-42e5-a4d8-2aa4fbdbeded admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.927438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbeca04-8ce2-4e3d-8780-a109f4a53f82 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.937126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbbfab-d993-4a06-ba80-0d5ce225d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.938303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbbfab-d993-4a06-ba80-0d5ce225d381 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.938879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbbfab-d993-4a06-ba80-0d5ce225d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.939422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822828ac-ebaa-45fb-8982-37442b15ddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.939580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbbfab-d993-4a06-ba80-0d5ce225d381 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.940053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822828ac-ebaa-45fb-8982-37442b15ddec admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.940387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822828ac-ebaa-45fb-8982-37442b15ddec admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.940567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbbfab-d993-4a06-ba80-0d5ce225d381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.940736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822828ac-ebaa-45fb-8982-37442b15ddec admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.941336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822828ac-ebaa-45fb-8982-37442b15ddec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.942981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822828ac-ebaa-45fb-8982-37442b15ddec admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.943237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbbfab-d993-4a06-ba80-0d5ce225d381 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:15.955368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 804/1589] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:15.955923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822828ac-ebaa-45fb-8982-37442b15ddec admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.969970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822828ac-ebaa-45fb-8982-37442b15ddec admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:15.978184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107d1b-ad16-4b07-a19a-9a2f61f1acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:15.979810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107d1b-ad16-4b07-a19a-9a2f61f1acb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:15.980386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107d1b-ad16-4b07-a19a-9a2f61f1acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:15.980864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107d1b-ad16-4b07-a19a-9a2f61f1acb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:15.982295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107d1b-ad16-4b07-a19a-9a2f61f1acb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:15.983255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 786/1590] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/users => generated 309 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:15.984050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbbfab-d993-4a06-ba80-0d5ce225d381 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:15.988331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107d1b-ad16-4b07-a19a-9a2f61f1acb8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.000080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbbfab-d993-4a06-ba80-0d5ce225d381 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.002476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 805/1591] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.006246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107d1b-ad16-4b07-a19a-9a2f61f1acb8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.010833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fa198-5563-44d6-963e-b234fc908abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.012947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fa198-5563-44d6-963e-b234fc908abc admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.013504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fa198-5563-44d6-963e-b234fc908abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.014252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fa198-5563-44d6-963e-b234fc908abc admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.015046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fa198-5563-44d6-963e-b234fc908abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.017328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fa198-5563-44d6-963e-b234fc908abc admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.023158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107d1b-ad16-4b07-a19a-9a2f61f1acb8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.029627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec258b85-3a92-47bc-a7a3-689eaefe8cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.030675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec258b85-3a92-47bc-a7a3-689eaefe8cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.031236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec258b85-3a92-47bc-a7a3-689eaefe8cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.031750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec258b85-3a92-47bc-a7a3-689eaefe8cf2 admin admin] PATH_INFO: `/v3/projects/07b81ab3fe6c4728bcbb84fdb11eaea6/users/f865fb654778404a846ec2465eeef8e2/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.049192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 787/1592] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:15 2022] POST /identity/v3/users => generated 288 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:16.053553 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fa198-5563-44d6-963e-b234fc908abc admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.057860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec258b85-3a92-47bc-a7a3-689eaefe8cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b81ab3fe6c4728bcbb84fdb11eaea6, user_id=f865fb654778404a846ec2465eeef8e2, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.059656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-ec258b85-3a92-47bc-a7a3-689eaefe8cf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:40:16.059656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Aug 26 15:40:16.059656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: Aug 26 15:40:16.063216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec258b85-3a92-47bc-a7a3-689eaefe8cf2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.069620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fa198-5563-44d6-963e-b234fc908abc admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.078058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640797d1-0de3-40ea-bec1-e96f0674213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.079133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640797d1-0de3-40ea-bec1-e96f0674213c admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.079732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640797d1-0de3-40ea-bec1-e96f0674213c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.080157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640797d1-0de3-40ea-bec1-e96f0674213c admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.080971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640797d1-0de3-40ea-bec1-e96f0674213c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.083481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640797d1-0de3-40ea-bec1-e96f0674213c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.095745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 806/1593] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:16 2022] PUT /identity/v3/projects/07b81ab3fe6c4728bcbb84fdb11eaea6/users/f865fb654778404a846ec2465eeef8e2/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:16.097240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec258b85-3a92-47bc-a7a3-689eaefe8cf2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.102769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:16.123355 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 788/1594] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:16 2022] POST /identity/v3/users => generated 292 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:16.128831 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640797d1-0de3-40ea-bec1-e96f0674213c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.129956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:16.155158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640797d1-0de3-40ea-bec1-e96f0674213c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.228835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec258b85-3a92-47bc-a7a3-689eaefe8cf2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.238876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e2dec-11fd-4fac-8bcb-627012c989d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.240892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e2dec-11fd-4fac-8bcb-627012c989d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.241377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e2dec-11fd-4fac-8bcb-627012c989d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.242458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e2dec-11fd-4fac-8bcb-627012c989d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.244337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e2dec-11fd-4fac-8bcb-627012c989d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.248832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e2dec-11fd-4fac-8bcb-627012c989d2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.256642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda02c29-46e1-4691-a534-def7c0801297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.257555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda02c29-46e1-4691-a534-def7c0801297 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.258133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda02c29-46e1-4691-a534-def7c0801297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.258454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda02c29-46e1-4691-a534-def7c0801297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.259150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda02c29-46e1-4691-a534-def7c0801297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.262257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda02c29-46e1-4691-a534-def7c0801297 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.279769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 789/1595] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.280985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda02c29-46e1-4691-a534-def7c0801297 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.286692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 807/1596] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:16 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:16.292187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e2dec-11fd-4fac-8bcb-627012c989d2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.303048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda02c29-46e1-4691-a534-def7c0801297 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.309402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e2dec-11fd-4fac-8bcb-627012c989d2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.311633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18be11-96f0-417a-84d4-b262736af8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.312741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18be11-96f0-417a-84d4-b262736af8ff admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.313288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18be11-96f0-417a-84d4-b262736af8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.313482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18be11-96f0-417a-84d4-b262736af8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.315208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18be11-96f0-417a-84d4-b262736af8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.317690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84dbbd-8bf1-4682-94b8-19deae96d8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.317983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18be11-96f0-417a-84d4-b262736af8ff admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.318542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84dbbd-8bf1-4682-94b8-19deae96d8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.318970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84dbbd-8bf1-4682-94b8-19deae96d8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.319420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84dbbd-8bf1-4682-94b8-19deae96d8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.320530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84dbbd-8bf1-4682-94b8-19deae96d8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.322391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84dbbd-8bf1-4682-94b8-19deae96d8c6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.342358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 808/1597] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.344336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84dbbd-8bf1-4682-94b8-19deae96d8c6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.347181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 790/1598] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.350604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19362-339e-4af1-9479-c160a11954bb None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.351704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19362-339e-4af1-9479-c160a11954bb None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.352525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e19362-339e-4af1-9479-c160a11954bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.364081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84dbbd-8bf1-4682-94b8-19deae96d8c6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.373480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ceadb-9713-4f0f-abdb-2f9afec3ae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.374643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ceadb-9713-4f0f-abdb-2f9afec3ae79 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.375247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ceadb-9713-4f0f-abdb-2f9afec3ae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.376045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ceadb-9713-4f0f-abdb-2f9afec3ae79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.377441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ceadb-9713-4f0f-abdb-2f9afec3ae79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.380635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ceadb-9713-4f0f-abdb-2f9afec3ae79 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.390686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-71e19362-339e-4af1-9479-c160a11954bb None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:16.393336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-71e19362-339e-4af1-9479-c160a11954bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:16.398897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 809/1599] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.400306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ceadb-9713-4f0f-abdb-2f9afec3ae79 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.416221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 791/1600] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:16.424292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ceadb-9713-4f0f-abdb-2f9afec3ae79 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.435888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98abd-9046-4680-872a-341023daf194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.435888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98abd-9046-4680-872a-341023daf194 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.435888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98abd-9046-4680-872a-341023daf194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.435888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae98abd-9046-4680-872a-341023daf194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.438307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae98abd-9046-4680-872a-341023daf194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.438307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae98abd-9046-4680-872a-341023daf194 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.443408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e19362-339e-4af1-9479-c160a11954bb None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.454986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 810/1601] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.454986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98abd-9046-4680-872a-341023daf194 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.465191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e19362-339e-4af1-9479-c160a11954bb None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.473809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae98abd-9046-4680-872a-341023daf194 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.475227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ed69f-7e91-4fb5-b07f-962121b4f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.476127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed69f-7e91-4fb5-b07f-962121b4f915 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.476604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed69f-7e91-4fb5-b07f-962121b4f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.477779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed69f-7e91-4fb5-b07f-962121b4f915 admin admin] PATH_INFO: `/v3/projects/ee657d7927d24daa9269f9c1338067d9/users/b18686529ecb4b5db2bd0648081c9c42/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.478740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a19155-6531-414a-a3b8-cc3ff9a7e352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.480030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a19155-6531-414a-a3b8-cc3ff9a7e352 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.480369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a19155-6531-414a-a3b8-cc3ff9a7e352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.480825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a19155-6531-414a-a3b8-cc3ff9a7e352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.481697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a19155-6531-414a-a3b8-cc3ff9a7e352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.483395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a19155-6531-414a-a3b8-cc3ff9a7e352 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.496444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 811/1602] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.497401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a19155-6531-414a-a3b8-cc3ff9a7e352 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.515796 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ed69f-7e91-4fb5-b07f-962121b4f915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee657d7927d24daa9269f9c1338067d9, user_id=b18686529ecb4b5db2bd0648081c9c42, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.522605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a19155-6531-414a-a3b8-cc3ff9a7e352 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.523614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ed69f-7e91-4fb5-b07f-962121b4f915 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.532579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c6cb5-980a-4fd4-96d0-7592e5480a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.533872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c6cb5-980a-4fd4-96d0-7592e5480a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.535290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c6cb5-980a-4fd4-96d0-7592e5480a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.535623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c6cb5-980a-4fd4-96d0-7592e5480a04 admin admin] PATH_INFO: `/v3/projects/00fe724f3acf408398d2ea2ba605a953/users/bf262533063b4bb99713c476447783f9/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.555016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 792/1603] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:16 2022] PUT /identity/v3/projects/ee657d7927d24daa9269f9c1338067d9/users/b18686529ecb4b5db2bd0648081c9c42/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:16.555016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ed69f-7e91-4fb5-b07f-962121b4f915 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.564034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c6cb5-980a-4fd4-96d0-7592e5480a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fe724f3acf408398d2ea2ba605a953, user_id=bf262533063b4bb99713c476447783f9, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.567340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c6cb5-980a-4fd4-96d0-7592e5480a04 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.594177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 812/1604] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:16 2022] PUT /identity/v3/projects/00fe724f3acf408398d2ea2ba605a953/users/bf262533063b4bb99713c476447783f9/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:16.595741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c6cb5-980a-4fd4-96d0-7592e5480a04 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.692132 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ed69f-7e91-4fb5-b07f-962121b4f915 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.721778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c6cb5-980a-4fd4-96d0-7592e5480a04 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.728114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184501f-1683-494e-a3ce-343af49d357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.728926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184501f-1683-494e-a3ce-343af49d357f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.729940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184501f-1683-494e-a3ce-343af49d357f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.730312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184501f-1683-494e-a3ce-343af49d357f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.732004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184501f-1683-494e-a3ce-343af49d357f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.733805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184501f-1683-494e-a3ce-343af49d357f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.748797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 813/1605] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:16.749781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184501f-1683-494e-a3ce-343af49d357f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.808520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:16.832288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:16.849731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bca92b-9669-4e7e-9165-4664f992c39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.850557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bca92b-9669-4e7e-9165-4664f992c39b admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.851016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bca92b-9669-4e7e-9165-4664f992c39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.851543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bca92b-9669-4e7e-9165-4664f992c39b admin admin] PATH_INFO: `/v3/projects/408e27a94f89486c87e2f67af9765e2c/users/1c265590c3c441ac85f882c491a06f73/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.859351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184501f-1683-494e-a3ce-343af49d357f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:16.869071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e260c-9be5-4c46-9b2e-0ca94e9cecd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:16.870630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e260c-9be5-4c46-9b2e-0ca94e9cecd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:16.871455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e260c-9be5-4c46-9b2e-0ca94e9cecd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:16.871984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e260c-9be5-4c46-9b2e-0ca94e9cecd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:16.880057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bca92b-9669-4e7e-9165-4664f992c39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=408e27a94f89486c87e2f67af9765e2c, user_id=1c265590c3c441ac85f882c491a06f73, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.886169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bca92b-9669-4e7e-9165-4664f992c39b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.890808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e260c-9be5-4c46-9b2e-0ca94e9cecd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:16.893489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e260c-9be5-4c46-9b2e-0ca94e9cecd1 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:16.914616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 814/1606] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:16.916278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e260c-9be5-4c46-9b2e-0ca94e9cecd1 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.923177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 793/1607] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:16 2022] PUT /identity/v3/projects/408e27a94f89486c87e2f67af9765e2c/users/1c265590c3c441ac85f882c491a06f73/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:16.924970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bca92b-9669-4e7e-9165-4664f992c39b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:16.958076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e260c-9be5-4c46-9b2e-0ca94e9cecd1 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.050100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bca92b-9669-4e7e-9165-4664f992c39b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.072931 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc162218-ba4c-47c1-8585-8cb215b49239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.074671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc162218-ba4c-47c1-8585-8cb215b49239 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.075303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc162218-ba4c-47c1-8585-8cb215b49239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.075953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc162218-ba4c-47c1-8585-8cb215b49239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.077536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc162218-ba4c-47c1-8585-8cb215b49239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.081685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc162218-ba4c-47c1-8585-8cb215b49239 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.094834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860fec7-37ce-4dbf-9c6a-80953b5a350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.096015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860fec7-37ce-4dbf-9c6a-80953b5a350f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.096770 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860fec7-37ce-4dbf-9c6a-80953b5a350f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.097330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860fec7-37ce-4dbf-9c6a-80953b5a350f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.098728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860fec7-37ce-4dbf-9c6a-80953b5a350f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.103508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860fec7-37ce-4dbf-9c6a-80953b5a350f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.110958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 794/1608] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:17.113715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231fab-be82-4cbe-bf8f-29558058d067 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.114333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231fab-be82-4cbe-bf8f-29558058d067 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.114904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231fab-be82-4cbe-bf8f-29558058d067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.133114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 815/1609] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:17.134580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860fec7-37ce-4dbf-9c6a-80953b5a350f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.161502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860fec7-37ce-4dbf-9c6a-80953b5a350f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.164971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-36231fab-be82-4cbe-bf8f-29558058d067 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:17.167364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-36231fab-be82-4cbe-bf8f-29558058d067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:17.171362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b61bb-ef91-422d-b10f-ab9a85c52d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.172593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b61bb-ef91-422d-b10f-ab9a85c52d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.173175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b61bb-ef91-422d-b10f-ab9a85c52d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.187429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b61bb-ef91-422d-b10f-ab9a85c52d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.188577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b61bb-ef91-422d-b10f-ab9a85c52d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.192432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 795/1610] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:17.194879 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b61bb-ef91-422d-b10f-ab9a85c52d6c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.195104 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231fab-be82-4cbe-bf8f-29558058d067 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.217938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231fab-be82-4cbe-bf8f-29558058d067 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.218525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 816/1611] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:17.221436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c95e7-a98d-4422-8293-ef853aaf4c84 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.222084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c95e7-a98d-4422-8293-ef853aaf4c84 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.222695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c95e7-a98d-4422-8293-ef853aaf4c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.241794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0e4bb-8e92-4be3-8b82-66fdfe9d3b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.243219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0e4bb-8e92-4be3-8b82-66fdfe9d3b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.243710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0e4bb-8e92-4be3-8b82-66fdfe9d3b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.244246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0e4bb-8e92-4be3-8b82-66fdfe9d3b8f admin admin] PATH_INFO: `/v3/projects/df305cf338a14da9898a35467de2811d/users/91137d4fc46f401aa969752a5adf176f/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.278267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0e4bb-8e92-4be3-8b82-66fdfe9d3b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df305cf338a14da9898a35467de2811d, user_id=91137d4fc46f401aa969752a5adf176f, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.280589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e91c95e7-a98d-4422-8293-ef853aaf4c84 None None] MFA Rules not processed for user `1c265590c3c441ac85f882c491a06f73`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:17.283417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e91c95e7-a98d-4422-8293-ef853aaf4c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:17.284784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0e4bb-8e92-4be3-8b82-66fdfe9d3b8f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.313366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 796/1612] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:17 2022] PUT /identity/v3/projects/df305cf338a14da9898a35467de2811d/users/91137d4fc46f401aa969752a5adf176f/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:17.314333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0e4bb-8e92-4be3-8b82-66fdfe9d3b8f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.391272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 817/1613] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:17.392498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c95e7-a98d-4422-8293-ef853aaf4c84 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.408004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c95e7-a98d-4422-8293-ef853aaf4c84 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.425266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0e4bb-8e92-4be3-8b82-66fdfe9d3b8f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.431521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb437c-2ae7-4b83-aff5-75e6afaf13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.432413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb437c-2ae7-4b83-aff5-75e6afaf13a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.432803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb437c-2ae7-4b83-aff5-75e6afaf13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.433205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb437c-2ae7-4b83-aff5-75e6afaf13a1 admin admin] PATH_INFO: `/v3/projects/abcf06067cb4412189b9e3bea052176e/users/5fa4a3ae97d546c283a6154948365323/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.455506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb437c-2ae7-4b83-aff5-75e6afaf13a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abcf06067cb4412189b9e3bea052176e, user_id=5fa4a3ae97d546c283a6154948365323, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.459864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb437c-2ae7-4b83-aff5-75e6afaf13a1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.469918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:17.500360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 797/1614] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:17 2022] PUT /identity/v3/projects/abcf06067cb4412189b9e3bea052176e/users/5fa4a3ae97d546c283a6154948365323/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:17.501134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb437c-2ae7-4b83-aff5-75e6afaf13a1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.513599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898dbb-8bc9-4cdd-8839-eebc07b5470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.515482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898dbb-8bc9-4cdd-8839-eebc07b5470c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.516597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898dbb-8bc9-4cdd-8839-eebc07b5470c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.516890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898dbb-8bc9-4cdd-8839-eebc07b5470c admin admin] PATH_INFO: `/v3/projects/bdd49a5192474cdcaf8759423837547b/users/e56d4b78d51b4a81842f5724aaff7f85/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.550567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c898dbb-8bc9-4cdd-8839-eebc07b5470c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd49a5192474cdcaf8759423837547b, user_id=e56d4b78d51b4a81842f5724aaff7f85, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.555090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:17.559206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c898dbb-8bc9-4cdd-8839-eebc07b5470c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.589779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 818/1615] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:17 2022] PUT /identity/v3/projects/bdd49a5192474cdcaf8759423837547b/users/e56d4b78d51b4a81842f5724aaff7f85/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:17.589779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898dbb-8bc9-4cdd-8839-eebc07b5470c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:17.601632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb437c-2ae7-4b83-aff5-75e6afaf13a1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.711212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7126f5-8d8d-46ec-82f9-b307529978e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.711605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898dbb-8bc9-4cdd-8839-eebc07b5470c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:17.711976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7126f5-8d8d-46ec-82f9-b307529978e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.712311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7126f5-8d8d-46ec-82f9-b307529978e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.712594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7126f5-8d8d-46ec-82f9-b307529978e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.719163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d895e8a-40e4-445a-9c11-071245364c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:17.720119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d895e8a-40e4-445a-9c11-071245364c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.720960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d895e8a-40e4-445a-9c11-071245364c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.721462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d895e8a-40e4-445a-9c11-071245364c6c admin admin] PATH_INFO: `/v3/projects/00fe724f3acf408398d2ea2ba605a953/users/bf262533063b4bb99713c476447783f9/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.726974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d895e8a-40e4-445a-9c11-071245364c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fe724f3acf408398d2ea2ba605a953, user_id=bf262533063b4bb99713c476447783f9, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.731670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d895e8a-40e4-445a-9c11-071245364c6c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.740939 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7126f5-8d8d-46ec-82f9-b307529978e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:17.743241 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7126f5-8d8d-46ec-82f9-b307529978e9 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:17.759695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 819/1616] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:17 2022] PUT /identity/v3/projects/00fe724f3acf408398d2ea2ba605a953/users/bf262533063b4bb99713c476447783f9/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:17.762216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c40e0-51a2-4ec2-a7a9-1cee584fde0f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.762507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 798/1617] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:17.762980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c40e0-51a2-4ec2-a7a9-1cee584fde0f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.763610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c40e0-51a2-4ec2-a7a9-1cee584fde0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.763951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97b7d-2786-4882-a164-8ffb689f79eb None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.764242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97b7d-2786-4882-a164-8ffb689f79eb None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.764527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97b7d-2786-4882-a164-8ffb689f79eb None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.772691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 799/1618] 10.222.0.89 () {54 vars in 962 bytes} [Fri Aug 26 15:40:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:17.774329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d41c-9340-4c54-83aa-43b1a0812299 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:17.774637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d41c-9340-4c54-83aa-43b1a0812299 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:17.774920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d41c-9340-4c54-83aa-43b1a0812299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:17.823751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f97c40e0-51a2-4ec2-a7a9-1cee584fde0f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:17.827898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f97c40e0-51a2-4ec2-a7a9-1cee584fde0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:17.832589 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-e350d41c-9340-4c54-83aa-43b1a0812299 None None] MFA Rules not processed for user `5fa4a3ae97d546c283a6154948365323`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:17.835496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e350d41c-9340-4c54-83aa-43b1a0812299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:18.029702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 800/1619] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:18.031483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95b1d-bfb7-4160-8ce3-afbdde30a683 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.032021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95b1d-bfb7-4160-8ce3-afbdde30a683 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.032406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95b1d-bfb7-4160-8ce3-afbdde30a683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.057956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 820/1620] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:18.057956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd660e9-1ba4-499a-86cb-a1178b1be952 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.057956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd660e9-1ba4-499a-86cb-a1178b1be952 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.057956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd660e9-1ba4-499a-86cb-a1178b1be952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.078157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-45c95b1d-bfb7-4160-8ce3-afbdde30a683 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:18.084242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-45c95b1d-bfb7-4160-8ce3-afbdde30a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:18.106252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 801/1621] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:18.110441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc5241-4ea3-4ef9-af24-099b35f1f157 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.111173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc5241-4ea3-4ef9-af24-099b35f1f157 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.111915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc5241-4ea3-4ef9-af24-099b35f1f157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.147369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8cd660e9-1ba4-499a-86cb-a1178b1be952 None None] MFA Rules not processed for user `bf262533063b4bb99713c476447783f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:18.149266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8cd660e9-1ba4-499a-86cb-a1178b1be952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:18.310916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-fdfc5241-4ea3-4ef9-af24-099b35f1f157 None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:18.310916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-fdfc5241-4ea3-4ef9-af24-099b35f1f157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:18.368419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:18.420403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 821/1622] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:18.420403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd660e9-1ba4-499a-86cb-a1178b1be952 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:18.491826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:18.543299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 802/1623] 10.222.0.89 () {58 vars in 1059 bytes} [Fri Aug 26 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:18.544975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329484f-294f-4a85-9cd5-cdbe761ade13 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.545575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329484f-294f-4a85-9cd5-cdbe761ade13 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.546057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329484f-294f-4a85-9cd5-cdbe761ade13 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.548952 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 803/1624] 10.222.0.89 () {54 vars in 962 bytes} [Fri Aug 26 15:40:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:18.551117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329484f-294f-4a85-9cd5-cdbe761ade13 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:18.594781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd660e9-1ba4-499a-86cb-a1178b1be952 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:18.603884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11410-5ef4-43fe-8ddf-17c8617fb321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:18.605549 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11410-5ef4-43fe-8ddf-17c8617fb321 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.606226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11410-5ef4-43fe-8ddf-17c8617fb321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.606635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d11410-5ef4-43fe-8ddf-17c8617fb321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.629220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d11410-5ef4-43fe-8ddf-17c8617fb321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:18.632370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d11410-5ef4-43fe-8ddf-17c8617fb321 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:18.660889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 822/1625] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:18.662550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11410-5ef4-43fe-8ddf-17c8617fb321 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:18.679871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329484f-294f-4a85-9cd5-cdbe761ade13 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:18.688501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200feedf-ddbe-486b-87ab-70448bf3b6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:18.690574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200feedf-ddbe-486b-87ab-70448bf3b6ca service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.691005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200feedf-ddbe-486b-87ab-70448bf3b6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.691439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200feedf-ddbe-486b-87ab-70448bf3b6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.716401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200feedf-ddbe-486b-87ab-70448bf3b6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:18.720788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200feedf-ddbe-486b-87ab-70448bf3b6ca service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:18.742295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 804/1626] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:18.743849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200feedf-ddbe-486b-87ab-70448bf3b6ca service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:18.768633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200feedf-ddbe-486b-87ab-70448bf3b6ca service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:18.780892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b20ff-b980-48ca-bb9f-2ab9361e88f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:18.780892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b20ff-b980-48ca-bb9f-2ab9361e88f8 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.780892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b20ff-b980-48ca-bb9f-2ab9361e88f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.780892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b20ff-b980-48ca-bb9f-2ab9361e88f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.849769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d11410-5ef4-43fe-8ddf-17c8617fb321 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:18.864095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d334b-a88b-45ba-b51a-da7ff91310ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:18.865306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d334b-a88b-45ba-b51a-da7ff91310ea service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.865789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d334b-a88b-45ba-b51a-da7ff91310ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.866352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d334b-a88b-45ba-b51a-da7ff91310ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:18.897912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d334b-a88b-45ba-b51a-da7ff91310ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:18.903636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d334b-a88b-45ba-b51a-da7ff91310ea service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:18.961543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b20ff-b980-48ca-bb9f-2ab9361e88f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:18.966451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b20ff-b980-48ca-bb9f-2ab9361e88f8 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:18.973791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 823/1627] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:18.985597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 805/1628] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:18.986134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c598-36ba-466b-8c5d-f7de82c92468 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:18.986774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c598-36ba-466b-8c5d-f7de82c92468 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:18.987577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c598-36ba-466b-8c5d-f7de82c92468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.041278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6d84c598-36ba-466b-8c5d-f7de82c92468 None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:19.045464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6d84c598-36ba-466b-8c5d-f7de82c92468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:19.090974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 824/1629] 10.222.0.89 () {58 vars in 1059 bytes} [Fri Aug 26 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:19.096554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b20ff-b980-48ca-bb9f-2ab9361e88f8 service nova] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:19.134966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b20ff-b980-48ca-bb9f-2ab9361e88f8 service nova] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:19.150232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7ca47-e8f0-4df1-93fc-5024320f8361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:19.152788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7ca47-e8f0-4df1-93fc-5024320f8361 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:19.153180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7ca47-e8f0-4df1-93fc-5024320f8361 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:19.153964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7ca47-e8f0-4df1-93fc-5024320f8361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.173615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7ca47-e8f0-4df1-93fc-5024320f8361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:19.176928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7ca47-e8f0-4df1-93fc-5024320f8361 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:19.197550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 806/1630] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:19.613309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84c598-36ba-466b-8c5d-f7de82c92468 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:19.654750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f28e-19a7-4f08-bd20-0d19ee82cb61 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:19.655663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f28e-19a7-4f08-bd20-0d19ee82cb61 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:19.655663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98f28e-19a7-4f08-bd20-0d19ee82cb61 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.659379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 807/1631] 10.222.0.89 () {54 vars in 912 bytes} [Fri Aug 26 15:40:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:19.666918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80504d-9252-4a0a-8ceb-ac4447e02c2d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:19.667381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84c598-36ba-466b-8c5d-f7de82c92468 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:19.667598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80504d-9252-4a0a-8ceb-ac4447e02c2d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:19.667885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80504d-9252-4a0a-8ceb-ac4447e02c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.697040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:19.698666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:19.699190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:19.699672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] PATH_INFO: `/v3/users/b9d3c73a95ae42c6ad6129b5c760190d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.714736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d3c73a95ae42c6ad6129b5c760190d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:19.719505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: WARNING py.warnings [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:40:19.719505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: warnings.warn(msg) Aug 26 15:40:19.719505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: Aug 26 15:40:19.739062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:19.747050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-df80504d-9252-4a0a-8ceb-ac4447e02c2d None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:19.751925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-df80504d-9252-4a0a-8ceb-ac4447e02c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:19.814337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 808/1632] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:19.830782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80504d-9252-4a0a-8ceb-ac4447e02c2d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:19.859481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80504d-9252-4a0a-8ceb-ac4447e02c2d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:19.878086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2551c81-3114-4dd9-8d10-e9f7118260a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:19.881404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2551c81-3114-4dd9-8d10-e9f7118260a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:19.882189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2551c81-3114-4dd9-8d10-e9f7118260a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:19.883555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2551c81-3114-4dd9-8d10-e9f7118260a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:19.945926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d3c73a95ae42c6ad6129b5c760190d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:19.946273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2551c81-3114-4dd9-8d10-e9f7118260a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:19.952036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2551c81-3114-4dd9-8d10-e9f7118260a9 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:20.004621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 809/1633] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:20.038554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d3c73a95ae42c6ad6129b5c760190d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.042481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d3c73a95ae42c6ad6129b5c760190d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.079840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d3c73a95ae42c6ad6129b5c760190d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.087705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2f0c88cd-214f-49b2-8d96-7b1d14b14a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d3c73a95ae42c6ad6129b5c760190d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.154130 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 825/1634] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:19 2022] DELETE /identity/v3/users/b9d3c73a95ae42c6ad6129b5c760190d => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:20.161494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15135d63-458a-43ae-8e79-df30e32fadce None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:20.162233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15135d63-458a-43ae-8e79-df30e32fadce None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:20.162866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15135d63-458a-43ae-8e79-df30e32fadce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:20.211870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc438-a875-4aa8-8b42-4f1319aeca12 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:20.212207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc438-a875-4aa8-8b42-4f1319aeca12 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:20.212413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc438-a875-4aa8-8b42-4f1319aeca12 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:20.214098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 826/1635] 10.222.0.89 () {54 vars in 912 bytes} [Fri Aug 26 15:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:40:20.220957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ef0c-e443-44b8-98e7-8fa01882c670 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:20.221233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ef0c-e443-44b8-98e7-8fa01882c670 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:20.221515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ef0c-e443-44b8-98e7-8fa01882c670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:20.244461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-15135d63-458a-43ae-8e79-df30e32fadce None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:20.245490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:20.252891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-15135d63-458a-43ae-8e79-df30e32fadce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.299328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7069ef0c-e443-44b8-98e7-8fa01882c670 None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:20.301925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7069ef0c-e443-44b8-98e7-8fa01882c670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.397805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:20.420023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 810/1636] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:20.460160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15135d63-458a-43ae-8e79-df30e32fadce None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:20.461830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-15135d63-458a-43ae-8e79-df30e32fadce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.556329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 827/1637] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:40:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:20.581757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069ef0c-e443-44b8-98e7-8fa01882c670 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:20.587345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7069ef0c-e443-44b8-98e7-8fa01882c670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.668396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15135d63-458a-43ae-8e79-df30e32fadce None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:20.673316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631bf42-dd90-48f7-be24-2cc8c2d1cedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:20.674137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631bf42-dd90-48f7-be24-2cc8c2d1cedb service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:20.674426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631bf42-dd90-48f7-be24-2cc8c2d1cedb service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:20.674738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631bf42-dd90-48f7-be24-2cc8c2d1cedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:20.730231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631bf42-dd90-48f7-be24-2cc8c2d1cedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:20.734111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631bf42-dd90-48f7-be24-2cc8c2d1cedb service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:20.752943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069ef0c-e443-44b8-98e7-8fa01882c670 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:20.756335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 811/1638] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:20.758315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631bf42-dd90-48f7-be24-2cc8c2d1cedb service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:20.766130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d631bf42-dd90-48f7-be24-2cc8c2d1cedb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:20.767738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612ad5d-5334-4eb9-9f06-dfb894efb470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:20.768507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612ad5d-5334-4eb9-9f06-dfb894efb470 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:20.768797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612ad5d-5334-4eb9-9f06-dfb894efb470 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:20.769072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612ad5d-5334-4eb9-9f06-dfb894efb470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:20.795307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612ad5d-5334-4eb9-9f06-dfb894efb470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:20.796073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631bf42-dd90-48f7-be24-2cc8c2d1cedb service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:20.797032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612ad5d-5334-4eb9-9f06-dfb894efb470 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:20.812766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:20.815481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:20.817814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:20.819403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] PATH_INFO: `/v3/users/1c265590c3c441ac85f882c491a06f73` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:20.823262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 828/1639] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:20.825071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c265590c3c441ac85f882c491a06f73)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:20.829196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:20.941115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c265590c3c441ac85f882c491a06f73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.942287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c265590c3c441ac85f882c491a06f73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.967514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c265590c3c441ac85f882c491a06f73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.990426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c265590c3c441ac85f882c491a06f73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:20.992058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c265590c3c441ac85f882c491a06f73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:21.021711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 812/1640] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:20 2022] DELETE /identity/v3/users/1c265590c3c441ac85f882c491a06f73 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:21.022480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d6e9a-aec3-44af-ad0e-f13716deac5b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:21.022786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d6e9a-aec3-44af-ad0e-f13716deac5b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:21.023446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d6e9a-aec3-44af-ad0e-f13716deac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:21.066013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f29d6e9a-aec3-44af-ad0e-f13716deac5b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:21.075240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f29d6e9a-aec3-44af-ad0e-f13716deac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:21.228525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 829/1641] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:21.353245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:21.356449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:21.533814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f335f89-e19f-4b42-92a3-7d962aeb3e3b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:21.549095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2d0d0-74bf-41f8-993d-1b535362bacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:21.552571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2d0d0-74bf-41f8-993d-1b535362bacb service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:21.558362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2d0d0-74bf-41f8-993d-1b535362bacb service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:21.559610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2d0d0-74bf-41f8-993d-1b535362bacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:21.597229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2d0d0-74bf-41f8-993d-1b535362bacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:21.608992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2d0d0-74bf-41f8-993d-1b535362bacb service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:21.628350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 813/1642] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:23.729169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d6e9a-aec3-44af-ad0e-f13716deac5b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:23.732534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f29d6e9a-aec3-44af-ad0e-f13716deac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:23.766271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d6e9a-aec3-44af-ad0e-f13716deac5b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:23.777846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:23.780462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:23.780867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:23.781294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] PATH_INFO: `/v3/projects/c056fa5edd894345abe568a8f242bbcb` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:23.783978 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c056fa5edd894345abe568a8f242bbcb)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:23.786293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:23.941237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:23.973453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c056fa5edd894345abe568a8f242bbcb', 'request_id': 'req-5b32d37b-3847-4139-bf20-83f9eb70aca9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:23.987092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c056fa5edd894345abe568a8f242bbcb', 'request_id': 'req-5b32d37b-3847-4139-bf20-83f9eb70aca9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.007290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c056fa5edd894345abe568a8f242bbcb', 'request_id': 'req-5b32d37b-3847-4139-bf20-83f9eb70aca9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.041203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] The token cache is being invalidate because project c056fa5edd894345abe568a8f242bbcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:24.042372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.043685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.046415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 830/1643] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:23 2022] DELETE /identity/v3/projects/c056fa5edd894345abe568a8f242bbcb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:24.052909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2d0d0-74bf-41f8-993d-1b535362bacb service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:24.078964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2d0d0-74bf-41f8-993d-1b535362bacb service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:24.162507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:24.322028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:24.329371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:24.330038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:24.331514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] PATH_INFO: `/v3/users/bf262533063b4bb99713c476447783f9` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:24.336824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf262533063b4bb99713c476447783f9)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:24.339207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:24.467664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf262533063b4bb99713c476447783f9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.468508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf262533063b4bb99713c476447783f9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.517930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf262533063b4bb99713c476447783f9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.545219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf262533063b4bb99713c476447783f9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.545806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e682dce-fafb-4f14-85ab-6e422aa850a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf262533063b4bb99713c476447783f9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:24.575382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 814/1644] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:24 2022] DELETE /identity/v3/users/bf262533063b4bb99713c476447783f9 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:24.820485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:24.822212 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:24.850831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32d37b-3847-4139-bf20-83f9eb70aca9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:25.008269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:25.009646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:25.009825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:25.010181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] PATH_INFO: `/v3/users/5fa4a3ae97d546c283a6154948365323` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:25.014459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa4a3ae97d546c283a6154948365323)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:25.017620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:25.131930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa4a3ae97d546c283a6154948365323'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.161777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa4a3ae97d546c283a6154948365323'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.165134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa4a3ae97d546c283a6154948365323'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.185244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa4a3ae97d546c283a6154948365323'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.185911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa4a3ae97d546c283a6154948365323'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.210515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 831/1645] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:24 2022] DELETE /identity/v3/users/5fa4a3ae97d546c283a6154948365323 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:25.215592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c46c1-6cb0-488b-b8a6-5ed95f2a4abb None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:25.216373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c46c1-6cb0-488b-b8a6-5ed95f2a4abb None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:25.216373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c46c1-6cb0-488b-b8a6-5ed95f2a4abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:25.257661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-e69c46c1-6cb0-488b-b8a6-5ed95f2a4abb None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:25.259089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e69c46c1-6cb0-488b-b8a6-5ed95f2a4abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:25.326102 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:25.327942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:25.449236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 815/1646] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:25.476030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:25.492790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c46c1-6cb0-488b-b8a6-5ed95f2a4abb None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:25.496805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e69c46c1-6cb0-488b-b8a6-5ed95f2a4abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:25.571268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aedf3-b589-41e7-af79-1d36d6790c95 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:25.587342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:25.588577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:25.588705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:25.589024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] PATH_INFO: `/v3/projects/408e27a94f89486c87e2f67af9765e2c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:25.592771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408e27a94f89486c87e2f67af9765e2c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:25.595032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:25.624485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:25.669527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c46c1-6cb0-488b-b8a6-5ed95f2a4abb None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:25.678295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e46d6-771e-41b7-ad1f-6071bf574557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:25.680711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e46d6-771e-41b7-ad1f-6071bf574557 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:25.692752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e46d6-771e-41b7-ad1f-6071bf574557 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:25.693890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e46d6-771e-41b7-ad1f-6071bf574557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:25.738282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e46d6-771e-41b7-ad1f-6071bf574557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:25.741911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e46d6-771e-41b7-ad1f-6071bf574557 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:25.747956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408e27a94f89486c87e2f67af9765e2c', 'request_id': 'req-a4c0c1ca-c823-47f8-a286-ded329dc4703'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.766047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408e27a94f89486c87e2f67af9765e2c', 'request_id': 'req-a4c0c1ca-c823-47f8-a286-ded329dc4703'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.783463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 816/1647] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:25.787238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408e27a94f89486c87e2f67af9765e2c', 'request_id': 'req-a4c0c1ca-c823-47f8-a286-ded329dc4703'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.808517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] The token cache is being invalidate because project 408e27a94f89486c87e2f67af9765e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:25.808812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.809705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a4c0c1ca-c823-47f8-a286-ded329dc4703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:25.811327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 832/1648] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:25 2022] DELETE /identity/v3/projects/408e27a94f89486c87e2f67af9765e2c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:25.817296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02a41-94ff-44af-a97a-7a7cbc453ae6 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:25.817594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02a41-94ff-44af-a97a-7a7cbc453ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:25.817874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b02a41-94ff-44af-a97a-7a7cbc453ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:25.889679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b1b02a41-94ff-44af-a97a-7a7cbc453ae6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:25.890968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b1b02a41-94ff-44af-a97a-7a7cbc453ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:26.125347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 817/1649] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:26.135352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2eccc-b987-49c1-a0b1-b48f082eeaba None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.136648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2eccc-b987-49c1-a0b1-b48f082eeaba None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.136880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2eccc-b987-49c1-a0b1-b48f082eeaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.196442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-99c2eccc-b987-49c1-a0b1-b48f082eeaba None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:26.197736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-99c2eccc-b987-49c1-a0b1-b48f082eeaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:26.210270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 833/1650] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:26.215075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02a41-94ff-44af-a97a-7a7cbc453ae6 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:26.244289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b02a41-94ff-44af-a97a-7a7cbc453ae6 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:26.267679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74e615-2108-4ded-bc70-49ce53d7205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:26.268651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74e615-2108-4ded-bc70-49ce53d7205a admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.269449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74e615-2108-4ded-bc70-49ce53d7205a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.269854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74e615-2108-4ded-bc70-49ce53d7205a admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.271038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74e615-2108-4ded-bc70-49ce53d7205a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:26.271396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74e615-2108-4ded-bc70-49ce53d7205a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:26.273825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74e615-2108-4ded-bc70-49ce53d7205a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:26.310785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 818/1651] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:40:26.315250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2eccc-b987-49c1-a0b1-b48f082eeaba None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:26.329716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2eccc-b987-49c1-a0b1-b48f082eeaba None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:26.341565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f530c3-4021-4cd6-bfe0-cd5c63763dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:26.342751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f530c3-4021-4cd6-bfe0-cd5c63763dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.343312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f530c3-4021-4cd6-bfe0-cd5c63763dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.343708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f530c3-4021-4cd6-bfe0-cd5c63763dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.344613 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f530c3-4021-4cd6-bfe0-cd5c63763dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:26.347633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f530c3-4021-4cd6-bfe0-cd5c63763dd5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:26.405553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 834/1652] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:26 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:26.407140 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74e615-2108-4ded-bc70-49ce53d7205a admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:26.426880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74e615-2108-4ded-bc70-49ce53d7205a admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:26.652590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590556de-be35-4269-8043-8aee992aeab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:26.653930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590556de-be35-4269-8043-8aee992aeab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.654236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590556de-be35-4269-8043-8aee992aeab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.659357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590556de-be35-4269-8043-8aee992aeab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.663878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590556de-be35-4269-8043-8aee992aeab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:26.666783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590556de-be35-4269-8043-8aee992aeab6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:26.751039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 819/1653] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:26 2022] POST /identity/v3/users => generated 284 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:26.757484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f530c3-4021-4cd6-bfe0-cd5c63763dd5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:26.786772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f530c3-4021-4cd6-bfe0-cd5c63763dd5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:26.812618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590556de-be35-4269-8043-8aee992aeab6 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:26.815814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-590556de-be35-4269-8043-8aee992aeab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:26.827065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d88465-93d3-4a67-9077-5c5bcce2a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:26.828176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d88465-93d3-4a67-9077-5c5bcce2a9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.832390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d88465-93d3-4a67-9077-5c5bcce2a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.835737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d88465-93d3-4a67-9077-5c5bcce2a9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.836777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d88465-93d3-4a67-9077-5c5bcce2a9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:26.846185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d88465-93d3-4a67-9077-5c5bcce2a9f2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:26.857266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590556de-be35-4269-8043-8aee992aeab6 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:26.875809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:26.876625 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.876917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.877197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] PATH_INFO: `/v3/projects/00fe724f3acf408398d2ea2ba605a953` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.878765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fe724f3acf408398d2ea2ba605a953)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:26.882022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: WARNING py.warnings [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 15:40:26.882022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: warnings.warn(msg) Aug 26 15:40:26.882022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: Aug 26 15:40:26.882361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 835/1654] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:26.883391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d88465-93d3-4a67-9077-5c5bcce2a9f2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:26.885656 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:26.929681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d88465-93d3-4a67-9077-5c5bcce2a9f2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:26.950997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022c971-b1d0-44c0-b68c-51e740f62d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:26.951973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022c971-b1d0-44c0-b68c-51e740f62d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:26.952255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022c971-b1d0-44c0-b68c-51e740f62d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:26.952593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022c971-b1d0-44c0-b68c-51e740f62d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:26.968758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022c971-b1d0-44c0-b68c-51e740f62d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:26.970783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022c971-b1d0-44c0-b68c-51e740f62d99 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:27.019768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 836/1655] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:27.021037 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022c971-b1d0-44c0-b68c-51e740f62d99 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:27.060259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fe724f3acf408398d2ea2ba605a953', 'request_id': 'req-03d67823-22ab-4d3a-bfa7-889ff06bc31a'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:27.062336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:27.080364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022c971-b1d0-44c0-b68c-51e740f62d99 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:27.098914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fe724f3acf408398d2ea2ba605a953', 'request_id': 'req-03d67823-22ab-4d3a-bfa7-889ff06bc31a'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:27.122864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fe724f3acf408398d2ea2ba605a953', 'request_id': 'req-03d67823-22ab-4d3a-bfa7-889ff06bc31a'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:27.195751 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] The token cache is being invalidate because project 00fe724f3acf408398d2ea2ba605a953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:27.196055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:27.197496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03d67823-22ab-4d3a-bfa7-889ff06bc31a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:27.204185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 820/1656] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:26 2022] DELETE /identity/v3/projects/00fe724f3acf408398d2ea2ba605a953 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:27.215343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45e80-91c6-4a18-a22e-c22d81c73f2d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.223267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45e80-91c6-4a18-a22e-c22d81c73f2d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.223660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45e80-91c6-4a18-a22e-c22d81c73f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.290774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a49e5d-2a00-4a7e-8e5d-00d38b9f76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:27.292662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49e5d-2a00-4a7e-8e5d-00d38b9f76ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.292662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49e5d-2a00-4a7e-8e5d-00d38b9f76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.292662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a49e5d-2a00-4a7e-8e5d-00d38b9f76ec admin admin] PATH_INFO: `/v3/projects/650de4090126460993ddc24cc50041d7/users/ef05c16c21514b2f916bb7d6362d2048/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.293650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f3f45e80-91c6-4a18-a22e-c22d81c73f2d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:27.300101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f3f45e80-91c6-4a18-a22e-c22d81c73f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:27.335743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 821/1657] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:27.336721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a49e5d-2a00-4a7e-8e5d-00d38b9f76ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=650de4090126460993ddc24cc50041d7, user_id=ef05c16c21514b2f916bb7d6362d2048, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:27.337181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470f91b-457b-473b-9880-4996827ff146 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.337482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470f91b-457b-473b-9880-4996827ff146 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.337851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470f91b-457b-473b-9880-4996827ff146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.339369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a49e5d-2a00-4a7e-8e5d-00d38b9f76ec admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:27.377786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 837/1658] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:27 2022] PUT /identity/v3/projects/650de4090126460993ddc24cc50041d7/users/ef05c16c21514b2f916bb7d6362d2048/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:27.379553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62d8b7-ef2c-44f0-a101-df64692dc8ee None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.380190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62d8b7-ef2c-44f0-a101-df64692dc8ee None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.380608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62d8b7-ef2c-44f0-a101-df64692dc8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.398248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:27.402595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b470f91b-457b-473b-9880-4996827ff146 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:27.404346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b470f91b-457b-473b-9880-4996827ff146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:27.462431 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ae62d8b7-ef2c-44f0-a101-df64692dc8ee None None] MFA Rules not processed for user `ef05c16c21514b2f916bb7d6362d2048`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:27.464405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ae62d8b7-ef2c-44f0-a101-df64692dc8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:27.614827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 822/1659] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:27.616420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470f91b-457b-473b-9880-4996827ff146 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:27.653258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470f91b-457b-473b-9880-4996827ff146 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:27.676212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df322877-09fc-4253-92d7-a206db1153a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:27.677404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df322877-09fc-4253-92d7-a206db1153a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.677848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df322877-09fc-4253-92d7-a206db1153a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.678289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df322877-09fc-4253-92d7-a206db1153a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.678419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 838/1660] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:27.683503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df322877-09fc-4253-92d7-a206db1153a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:27.684026 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df322877-09fc-4253-92d7-a206db1153a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:27.684236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62d8b7-ef2c-44f0-a101-df64692dc8ee None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:27.685865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ae62d8b7-ef2c-44f0-a101-df64692dc8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:27.695252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df322877-09fc-4253-92d7-a206db1153a4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:27.722318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62d8b7-ef2c-44f0-a101-df64692dc8ee None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:27.747117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53cdd-8fe7-4e5a-9e2e-636d84317384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:27.747771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53cdd-8fe7-4e5a-9e2e-636d84317384 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.748055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53cdd-8fe7-4e5a-9e2e-636d84317384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.748331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53cdd-8fe7-4e5a-9e2e-636d84317384 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.749418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53cdd-8fe7-4e5a-9e2e-636d84317384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:27.752984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53cdd-8fe7-4e5a-9e2e-636d84317384 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:27.757487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 823/1661] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:27.759021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df322877-09fc-4253-92d7-a206db1153a4 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:27.791116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df322877-09fc-4253-92d7-a206db1153a4 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:27.812611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77471f3c-74ed-4aec-82ba-ccfef9a03d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:27.813471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77471f3c-74ed-4aec-82ba-ccfef9a03d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:27.813955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77471f3c-74ed-4aec-82ba-ccfef9a03d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:27.814415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77471f3c-74ed-4aec-82ba-ccfef9a03d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:27.815313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77471f3c-74ed-4aec-82ba-ccfef9a03d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:27.817542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77471f3c-74ed-4aec-82ba-ccfef9a03d6b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:27.868400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 839/1662] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:27.869538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53cdd-8fe7-4e5a-9e2e-636d84317384 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:27.915285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 824/1663] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:27.916578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77471f3c-74ed-4aec-82ba-ccfef9a03d6b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.043922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53cdd-8fe7-4e5a-9e2e-636d84317384 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.096427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77471f3c-74ed-4aec-82ba-ccfef9a03d6b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.109089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea940f8-ed39-4b0b-9586-30469d0de200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.109850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea940f8-ed39-4b0b-9586-30469d0de200 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.110207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea940f8-ed39-4b0b-9586-30469d0de200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.110541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea940f8-ed39-4b0b-9586-30469d0de200 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.111371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea940f8-ed39-4b0b-9586-30469d0de200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.123827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea940f8-ed39-4b0b-9586-30469d0de200 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.192194 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 825/1664] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:28.198634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea940f8-ed39-4b0b-9586-30469d0de200 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.229622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea940f8-ed39-4b0b-9586-30469d0de200 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.247109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8c26c-dede-4dbc-afca-c5a430d53f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.248185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c26c-dede-4dbc-afca-c5a430d53f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.250069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c26c-dede-4dbc-afca-c5a430d53f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.255671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c26c-dede-4dbc-afca-c5a430d53f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.257847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8c26c-dede-4dbc-afca-c5a430d53f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.262133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68843674-2c01-40c3-830b-bc88080fee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.265342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68843674-2c01-40c3-830b-bc88080fee24 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.265808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8c26c-dede-4dbc-afca-c5a430d53f6b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.266376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68843674-2c01-40c3-830b-bc88080fee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.267723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68843674-2c01-40c3-830b-bc88080fee24 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.269710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68843674-2c01-40c3-830b-bc88080fee24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.279105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68843674-2c01-40c3-830b-bc88080fee24 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.305673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 826/1665] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:40:28.312818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8c26c-dede-4dbc-afca-c5a430d53f6b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.317595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-78f8c26c-dede-4dbc-afca-c5a430d53f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:28.363210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 840/1666] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:27 2022] POST /identity/v3/users => generated 290 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:28.364428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68843674-2c01-40c3-830b-bc88080fee24 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.376813 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8c26c-dede-4dbc-afca-c5a430d53f6b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.388605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68843674-2c01-40c3-830b-bc88080fee24 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.390025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.390909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.391504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.391848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] PATH_INFO: `/v3/projects/abcf06067cb4412189b9e3bea052176e` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.393585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abcf06067cb4412189b9e3bea052176e)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.399075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.404401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef65108-e1c3-4e5b-97af-6b0489a8dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.405033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef65108-e1c3-4e5b-97af-6b0489a8dbba admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.406155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef65108-e1c3-4e5b-97af-6b0489a8dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.406155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef65108-e1c3-4e5b-97af-6b0489a8dbba admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.406634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef65108-e1c3-4e5b-97af-6b0489a8dbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.412379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef65108-e1c3-4e5b-97af-6b0489a8dbba admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.414033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:28.431482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:28.447443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 841/1667] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:28.449184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef65108-e1c3-4e5b-97af-6b0489a8dbba admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.477890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef65108-e1c3-4e5b-97af-6b0489a8dbba admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.485645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3bff4-880c-45bf-86a3-ce3e2d690c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.494080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3bff4-880c-45bf-86a3-ce3e2d690c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.494527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3bff4-880c-45bf-86a3-ce3e2d690c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.495393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3bff4-880c-45bf-86a3-ce3e2d690c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.502345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3bff4-880c-45bf-86a3-ce3e2d690c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.505889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3bff4-880c-45bf-86a3-ce3e2d690c2e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.534262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abcf06067cb4412189b9e3bea052176e', 'request_id': 'req-f315ab05-9b2f-4a0e-9829-52539d72dd87'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.539689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 842/1668] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:28.540871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3bff4-880c-45bf-86a3-ce3e2d690c2e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.555591 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abcf06067cb4412189b9e3bea052176e', 'request_id': 'req-f315ab05-9b2f-4a0e-9829-52539d72dd87'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.560183 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3bff4-880c-45bf-86a3-ce3e2d690c2e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.576395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abcf06067cb4412189b9e3bea052176e', 'request_id': 'req-f315ab05-9b2f-4a0e-9829-52539d72dd87'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.606021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] The token cache is being invalidate because project abcf06067cb4412189b9e3bea052176e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:28.606643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.612887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:28.616122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 827/1669] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:28 2022] DELETE /identity/v3/projects/abcf06067cb4412189b9e3bea052176e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:28.617069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:28.621930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:28.743238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0741c53-e9e4-42a8-bf53-8d9af771b396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.744323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0741c53-e9e4-42a8-bf53-8d9af771b396 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.744609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0741c53-e9e4-42a8-bf53-8d9af771b396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.746091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0741c53-e9e4-42a8-bf53-8d9af771b396 admin admin] PATH_INFO: `/v3/projects/3abce31bcbc346cb8c2c3f73e79db5b6/users/1a2e2879196040d4b87e30740acde4a8/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.806128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0741c53-e9e4-42a8-bf53-8d9af771b396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abce31bcbc346cb8c2c3f73e79db5b6, user_id=1a2e2879196040d4b87e30740acde4a8, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.808992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315ab05-9b2f-4a0e-9829-52539d72dd87 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:28.810957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0741c53-e9e4-42a8-bf53-8d9af771b396 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.815668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6915d22-8477-493e-973c-7cffc650bf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:28.816375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6915d22-8477-493e-973c-7cffc650bf4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.816700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6915d22-8477-493e-973c-7cffc650bf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.816988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6915d22-8477-493e-973c-7cffc650bf4f admin admin] PATH_INFO: `/v3/projects/487b36aab10546438ff3877693d52d4f/users/68ab494abf914a3d9c7c5cabafd06d0f/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.837090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6915d22-8477-493e-973c-7cffc650bf4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=487b36aab10546438ff3877693d52d4f, user_id=68ab494abf914a3d9c7c5cabafd06d0f, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:28.839489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 843/1670] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:28 2022] PUT /identity/v3/projects/3abce31bcbc346cb8c2c3f73e79db5b6/users/1a2e2879196040d4b87e30740acde4a8/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:28.841914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad6c7-195b-464c-8d7e-6a999a245140 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.842629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad6c7-195b-464c-8d7e-6a999a245140 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.843121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ad6c7-195b-464c-8d7e-6a999a245140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.852652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6915d22-8477-493e-973c-7cffc650bf4f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:28.894327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 828/1671] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:28 2022] PUT /identity/v3/projects/487b36aab10546438ff3877693d52d4f/users/68ab494abf914a3d9c7c5cabafd06d0f/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:28.896419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa58ea8-86eb-445a-b7b8-ff85917c8ae2 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:28.896863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa58ea8-86eb-445a-b7b8-ff85917c8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:28.897350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa58ea8-86eb-445a-b7b8-ff85917c8ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:28.925859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c72ad6c7-195b-464c-8d7e-6a999a245140 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:28.928140 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c72ad6c7-195b-464c-8d7e-6a999a245140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:28.939892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-aaa58ea8-86eb-445a-b7b8-ff85917c8ae2 None None] MFA Rules not processed for user `1a2e2879196040d4b87e30740acde4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:28.943254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-aaa58ea8-86eb-445a-b7b8-ff85917c8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.118438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 844/1672] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:29.120542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad6c7-195b-464c-8d7e-6a999a245140 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.139152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 829/1673] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:29.142199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee459a7-24d3-48c1-b801-898cda91c340 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.142199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee459a7-24d3-48c1-b801-898cda91c340 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.142199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee459a7-24d3-48c1-b801-898cda91c340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.144752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ad6c7-195b-464c-8d7e-6a999a245140 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.154366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c5ca3-eb06-432b-a2fd-277f14a0e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.155019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c5ca3-eb06-432b-a2fd-277f14a0e9ac admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.155301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c5ca3-eb06-432b-a2fd-277f14a0e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.155572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c5ca3-eb06-432b-a2fd-277f14a0e9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.156251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c5ca3-eb06-432b-a2fd-277f14a0e9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.158092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c5ca3-eb06-432b-a2fd-277f14a0e9ac admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.182047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 845/1674] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:29.188730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c5ca3-eb06-432b-a2fd-277f14a0e9ac admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.194753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1ee459a7-24d3-48c1-b801-898cda91c340 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:29.195477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1ee459a7-24d3-48c1-b801-898cda91c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.197741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c32c5ca3-eb06-432b-a2fd-277f14a0e9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.214332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c5ca3-eb06-432b-a2fd-277f14a0e9ac admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.218377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 830/1675] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:29.219373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee459a7-24d3-48c1-b801-898cda91c340 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.226068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f741aa-692a-409c-8213-8530328db2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.226769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f741aa-692a-409c-8213-8530328db2cf admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.227296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f741aa-692a-409c-8213-8530328db2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.227584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f741aa-692a-409c-8213-8530328db2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.228281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f741aa-692a-409c-8213-8530328db2cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.234603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f741aa-692a-409c-8213-8530328db2cf admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.236853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:29.247234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee459a7-24d3-48c1-b801-898cda91c340 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.267860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b70bbe-a438-4520-a940-92b9b2f45472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.268662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b70bbe-a438-4520-a940-92b9b2f45472 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.269023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b70bbe-a438-4520-a940-92b9b2f45472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.269360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b70bbe-a438-4520-a940-92b9b2f45472 admin admin] PATH_INFO: `/v3/projects/487b36aab10546438ff3877693d52d4f/users/68ab494abf914a3d9c7c5cabafd06d0f/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.272095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b70bbe-a438-4520-a940-92b9b2f45472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487b36aab10546438ff3877693d52d4f, user_id=68ab494abf914a3d9c7c5cabafd06d0f, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.275075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b70bbe-a438-4520-a940-92b9b2f45472 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.299465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 831/1676] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:29 2022] PUT /identity/v3/projects/487b36aab10546438ff3877693d52d4f/users/68ab494abf914a3d9c7c5cabafd06d0f/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:29.300923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b70bbe-a438-4520-a940-92b9b2f45472 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.324791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 846/1677] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:29 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:29.326164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e1fb-831e-4370-884d-dd207dd45f73 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.326694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e1fb-831e-4370-884d-dd207dd45f73 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.327184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e1fb-831e-4370-884d-dd207dd45f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.426208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-61e7e1fb-831e-4370-884d-dd207dd45f73 None None] MFA Rules not processed for user `68ab494abf914a3d9c7c5cabafd06d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:29.430345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-61e7e1fb-831e-4370-884d-dd207dd45f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.433891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b70bbe-a438-4520-a940-92b9b2f45472 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.496230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:29.588646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.589391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.590186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.590758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.593045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:29.593643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.596900 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.602593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 847/1678] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:29.607470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e1fb-831e-4370-884d-dd207dd45f73 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.627569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e1fb-831e-4370-884d-dd207dd45f73 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.633508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a00a2-815f-4d81-be06-bb713408b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.633508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a00a2-815f-4d81-be06-bb713408b489 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.633872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a00a2-815f-4d81-be06-bb713408b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.633872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a00a2-815f-4d81-be06-bb713408b489 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.634610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 832/1679] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:29.634765 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a00a2-815f-4d81-be06-bb713408b489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.636359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.636640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a00a2-815f-4d81-be06-bb713408b489 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.639485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:29.669776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 848/1680] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:29 2022] POST /identity/v3/users => generated 297 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:29.669776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a00a2-815f-4d81-be06-bb713408b489 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.684563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a00a2-815f-4d81-be06-bb713408b489 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:29.696022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521c9b7-01af-4897-bbd4-aa444e7ecfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:29.697251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521c9b7-01af-4897-bbd4-aa444e7ecfc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:29.697623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521c9b7-01af-4897-bbd4-aa444e7ecfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:29.698240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521c9b7-01af-4897-bbd4-aa444e7ecfc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:29.699379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521c9b7-01af-4897-bbd4-aa444e7ecfc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:29.712538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521c9b7-01af-4897-bbd4-aa444e7ecfc6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:29.837524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 849/1681] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:29 2022] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:29.844227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521c9b7-01af-4897-bbd4-aa444e7ecfc6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:29.913843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4439bf-5f28-43b0-94e4-549b61c68703 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.030176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521c9b7-01af-4897-bbd4-aa444e7ecfc6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.060976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a4358-71fe-4c11-9e05-9aa414a952e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.061542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a4358-71fe-4c11-9e05-9aa414a952e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.061823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a4358-71fe-4c11-9e05-9aa414a952e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.062098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a4358-71fe-4c11-9e05-9aa414a952e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.063243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a4358-71fe-4c11-9e05-9aa414a952e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.065209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a4358-71fe-4c11-9e05-9aa414a952e4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.091244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 850/1682] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:30.092254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a4358-71fe-4c11-9e05-9aa414a952e4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.122401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a4358-71fe-4c11-9e05-9aa414a952e4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.130658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38756e-4b79-401d-af94-77a5ad4d7332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.131594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38756e-4b79-401d-af94-77a5ad4d7332 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.131969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38756e-4b79-401d-af94-77a5ad4d7332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.132340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38756e-4b79-401d-af94-77a5ad4d7332 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.133278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38756e-4b79-401d-af94-77a5ad4d7332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.136535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38756e-4b79-401d-af94-77a5ad4d7332 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.153100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:30.162631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f533e0-a313-4438-878a-4617d56dc5f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.171610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f533e0-a313-4438-878a-4617d56dc5f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.172359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f533e0-a313-4438-878a-4617d56dc5f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.172882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f533e0-a313-4438-878a-4617d56dc5f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.184239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 851/1683] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:30 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:30.185263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38756e-4b79-401d-af94-77a5ad4d7332 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.199393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38756e-4b79-401d-af94-77a5ad4d7332 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.205614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c486fd3-8cfb-45a8-bee3-25531985d011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.206509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c486fd3-8cfb-45a8-bee3-25531985d011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.206945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c486fd3-8cfb-45a8-bee3-25531985d011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.207997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c486fd3-8cfb-45a8-bee3-25531985d011 admin admin] PATH_INFO: `/v3/projects/39d9af8cde764969a2faafef6731d6ab/users/68a77570e7a7427daa2e323dc1445eca/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.235650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c486fd3-8cfb-45a8-bee3-25531985d011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d9af8cde764969a2faafef6731d6ab, user_id=68a77570e7a7427daa2e323dc1445eca, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.238546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c486fd3-8cfb-45a8-bee3-25531985d011 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.300110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 852/1684] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:30 2022] PUT /identity/v3/projects/39d9af8cde764969a2faafef6731d6ab/users/68a77570e7a7427daa2e323dc1445eca/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:30.323516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c486fd3-8cfb-45a8-bee3-25531985d011 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.420155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f533e0-a313-4438-878a-4617d56dc5f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.421631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f533e0-a313-4438-878a-4617d56dc5f2 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.458962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:30.467483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 833/1685] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:30.469045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f533e0-a313-4438-878a-4617d56dc5f2 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.504801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f533e0-a313-4438-878a-4617d56dc5f2 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.614813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c486fd3-8cfb-45a8-bee3-25531985d011 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.638962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a5470-aefc-412c-b4ed-f3c4f466fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.639291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a5470-aefc-412c-b4ed-f3c4f466fff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.639634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a5470-aefc-412c-b4ed-f3c4f466fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.639804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a5470-aefc-412c-b4ed-f3c4f466fff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.640428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a5470-aefc-412c-b4ed-f3c4f466fff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.642064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a5470-aefc-412c-b4ed-f3c4f466fff3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.668699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b17ec-54b7-47f3-a7ca-c4d332b62d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.669628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b17ec-54b7-47f3-a7ca-c4d332b62d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.670149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b17ec-54b7-47f3-a7ca-c4d332b62d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.670554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b17ec-54b7-47f3-a7ca-c4d332b62d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.671743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b17ec-54b7-47f3-a7ca-c4d332b62d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.678707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b17ec-54b7-47f3-a7ca-c4d332b62d5b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.719224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 834/1686] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:30.719224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b17ec-54b7-47f3-a7ca-c4d332b62d5b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.725337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 853/1687] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:30.733564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a5470-aefc-412c-b4ed-f3c4f466fff3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.752617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b17ec-54b7-47f3-a7ca-c4d332b62d5b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.772024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56aea-73ae-4cef-894c-413a0ff7f9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.772728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56aea-73ae-4cef-894c-413a0ff7f9db admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.773009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56aea-73ae-4cef-894c-413a0ff7f9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.773285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56aea-73ae-4cef-894c-413a0ff7f9db admin admin] PATH_INFO: `/v3/projects/39d9af8cde764969a2faafef6731d6ab/users/68a77570e7a7427daa2e323dc1445eca/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.780617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d56aea-73ae-4cef-894c-413a0ff7f9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d9af8cde764969a2faafef6731d6ab, user_id=68a77570e7a7427daa2e323dc1445eca, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.784835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a5470-aefc-412c-b4ed-f3c4f466fff3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:30.785933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d56aea-73ae-4cef-894c-413a0ff7f9db admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.810252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743c5f2-81dd-4ecd-9558-cde1a8557be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:30.813530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743c5f2-81dd-4ecd-9558-cde1a8557be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.814691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743c5f2-81dd-4ecd-9558-cde1a8557be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.819105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743c5f2-81dd-4ecd-9558-cde1a8557be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.820506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743c5f2-81dd-4ecd-9558-cde1a8557be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:30.828518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 835/1688] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:30 2022] PUT /identity/v3/projects/39d9af8cde764969a2faafef6731d6ab/users/68a77570e7a7427daa2e323dc1445eca/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:30.832664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de94bf-5ae2-4ef1-90d3-b4df57d035d6 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:30.832954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de94bf-5ae2-4ef1-90d3-b4df57d035d6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:30.833232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de94bf-5ae2-4ef1-90d3-b4df57d035d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:30.852124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743c5f2-81dd-4ecd-9558-cde1a8557be8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:30.886424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 854/1689] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:30.896738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743c5f2-81dd-4ecd-9558-cde1a8557be8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:30.927847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743c5f2-81dd-4ecd-9558-cde1a8557be8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:31.007912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-98de94bf-5ae2-4ef1-90d3-b4df57d035d6 None None] MFA Rules not processed for user `68a77570e7a7427daa2e323dc1445eca`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:31.009714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-98de94bf-5ae2-4ef1-90d3-b4df57d035d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:31.107347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eccc56-0964-44ed-a333-74f80db860b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:31.107733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eccc56-0964-44ed-a333-74f80db860b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.108817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eccc56-0964-44ed-a333-74f80db860b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.108817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eccc56-0964-44ed-a333-74f80db860b5 admin admin] PATH_INFO: `/v3/projects/88e44c5565624c26b1478678454c51ba/users/794b4a8edbbf431abbd20bab461e802f/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.162026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eccc56-0964-44ed-a333-74f80db860b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e44c5565624c26b1478678454c51ba, user_id=794b4a8edbbf431abbd20bab461e802f, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:31.166283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eccc56-0964-44ed-a333-74f80db860b5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:31.204118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 836/1690] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:31.217996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de94bf-5ae2-4ef1-90d3-b4df57d035d6 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:31.218906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 855/1691] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:30 2022] PUT /identity/v3/projects/88e44c5565624c26b1478678454c51ba/users/794b4a8edbbf431abbd20bab461e802f/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:31.226346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70755-6fdd-4c6c-95ea-7de2973c8044 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.227424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70755-6fdd-4c6c-95ea-7de2973c8044 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.228706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70755-6fdd-4c6c-95ea-7de2973c8044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.257413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:31.327771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d4e70755-6fdd-4c6c-95ea-7de2973c8044 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:31.336726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d4e70755-6fdd-4c6c-95ea-7de2973c8044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:31.444552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de94bf-5ae2-4ef1-90d3-b4df57d035d6 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:31.534197 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 856/1692] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:31.625523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520d481-78ec-4121-a689-8346013f4f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:31.629443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520d481-78ec-4121-a689-8346013f4f12 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.631153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520d481-78ec-4121-a689-8346013f4f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.643539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520d481-78ec-4121-a689-8346013f4f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.676402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70755-6fdd-4c6c-95ea-7de2973c8044 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:31.678796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d4e70755-6fdd-4c6c-95ea-7de2973c8044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:31.832134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:31.864730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70755-6fdd-4c6c-95ea-7de2973c8044 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:31.875853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4149c6-ac76-40f4-9e4b-e32813a14ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:31.876696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4149c6-ac76-40f4-9e4b-e32813a14ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.876988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4149c6-ac76-40f4-9e4b-e32813a14ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.877332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4149c6-ac76-40f4-9e4b-e32813a14ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.900826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4149c6-ac76-40f4-9e4b-e32813a14ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:31.902638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4149c6-ac76-40f4-9e4b-e32813a14ba2 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:31.938589 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520d481-78ec-4121-a689-8346013f4f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:31.940130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520d481-78ec-4121-a689-8346013f4f12 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:31.944642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 857/1693] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:31.944642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0113-9dfa-4dbf-95ce-4de8b87b83e0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:31.945021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0113-9dfa-4dbf-95ce-4de8b87b83e0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:31.945173 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f0113-9dfa-4dbf-95ce-4de8b87b83e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:31.971113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 837/1694] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:32.010322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e92f0113-9dfa-4dbf-95ce-4de8b87b83e0 None None] MFA Rules not processed for user `66a5f1265c2f44fbb9a58d8d163b8460`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:32.012820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e92f0113-9dfa-4dbf-95ce-4de8b87b83e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:32.174484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520d481-78ec-4121-a689-8346013f4f12 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:32.188775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520d481-78ec-4121-a689-8346013f4f12 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:32.203496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23eaed-8351-4b39-a946-7d688cc88ded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:32.204461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23eaed-8351-4b39-a946-7d688cc88ded service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.204814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23eaed-8351-4b39-a946-7d688cc88ded service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.205249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23eaed-8351-4b39-a946-7d688cc88ded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.330094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 858/1695] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:32.340790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e60df-a48d-412e-a521-e596ceb1433d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.343478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e60df-a48d-412e-a521-e596ceb1433d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.345113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e60df-a48d-412e-a521-e596ceb1433d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.381201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23eaed-8351-4b39-a946-7d688cc88ded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:32.382709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23eaed-8351-4b39-a946-7d688cc88ded service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:32.405022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 838/1696] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:32.448712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-630e60df-a48d-412e-a521-e596ceb1433d None None] MFA Rules not processed for user `66a5f1265c2f44fbb9a58d8d163b8460`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:32.449972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-630e60df-a48d-412e-a521-e596ceb1433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:32.471506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 859/1697] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:32.479317 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23eaed-8351-4b39-a946-7d688cc88ded service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:32.481167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9e23eaed-8351-4b39-a946-7d688cc88ded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:32.516650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:32.747285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23eaed-8351-4b39-a946-7d688cc88ded service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:32.758699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a22a8-bf29-4bac-9cc2-f1bd52714944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:32.760200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a22a8-bf29-4bac-9cc2-f1bd52714944 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:32.761176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a22a8-bf29-4bac-9cc2-f1bd52714944 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:32.761769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a22a8-bf29-4bac-9cc2-f1bd52714944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:32.788975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a22a8-bf29-4bac-9cc2-f1bd52714944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:32.797509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a22a8-bf29-4bac-9cc2-f1bd52714944 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:32.827420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 839/1698] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:32 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:34.390575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c07c4d-dd90-4fcf-a8ca-155c858b817b None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:34.391184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c07c4d-dd90-4fcf-a8ca-155c858b817b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:34.391776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c07c4d-dd90-4fcf-a8ca-155c858b817b None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:34.394178 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 860/1699] 10.222.0.89 () {54 vars in 912 bytes} [Fri Aug 26 15:40:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:34.401376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619b7d7-9491-46cc-9caf-c331fdfe1ec9 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:34.402603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619b7d7-9491-46cc-9caf-c331fdfe1ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:34.403330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619b7d7-9491-46cc-9caf-c331fdfe1ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:34.560006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-3619b7d7-9491-46cc-9caf-c331fdfe1ec9 None None] MFA Rules not processed for user `a7a82c500de745c0b55df44b7f641706`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:34.561419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3619b7d7-9491-46cc-9caf-c331fdfe1ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:34.594122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 840/1700] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:40:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:34.819849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c07c4d-dd90-4fcf-a8ca-155c858b817b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:34.822672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a8c07c4d-dd90-4fcf-a8ca-155c858b817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:34.872382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619b7d7-9491-46cc-9caf-c331fdfe1ec9 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:34.878655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c07c4d-dd90-4fcf-a8ca-155c858b817b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:34.890396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619b7d7-9491-46cc-9caf-c331fdfe1ec9 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:34.894042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f7002-026f-4b34-bab2-23c21443e4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:34.894800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f7002-026f-4b34-bab2-23c21443e4ee service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:34.895112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f7002-026f-4b34-bab2-23c21443e4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:34.895379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f7002-026f-4b34-bab2-23c21443e4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:34.928014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:34.929090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:34.929904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:34.930075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] PATH_INFO: `/v3/users/ef05c16c21514b2f916bb7d6362d2048` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:34.934818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f7002-026f-4b34-bab2-23c21443e4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:34.937208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f7002-026f-4b34-bab2-23c21443e4ee service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:34.939871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef05c16c21514b2f916bb7d6362d2048)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:34.942647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:34.953035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 861/1701] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:35.121329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef05c16c21514b2f916bb7d6362d2048'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.122240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef05c16c21514b2f916bb7d6362d2048'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.160586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef05c16c21514b2f916bb7d6362d2048'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.172711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef05c16c21514b2f916bb7d6362d2048'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.173951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef05c16c21514b2f916bb7d6362d2048'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.199882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 841/1702] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:34 2022] DELETE /identity/v3/users/ef05c16c21514b2f916bb7d6362d2048 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:35.204935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68c5e-083b-49e5-967f-7d0bc28f2b8c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.206193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68c5e-083b-49e5-967f-7d0bc28f2b8c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.206653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c68c5e-083b-49e5-967f-7d0bc28f2b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.241100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-05c68c5e-083b-49e5-967f-7d0bc28f2b8c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:35.242993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-05c68c5e-083b-49e5-967f-7d0bc28f2b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.252295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.254174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.441437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:35.486057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7965d88-6cc2-4f36-b0bd-9979fb0c48f1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.503258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 862/1703] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:35.508790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.509479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.509949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.511145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] PATH_INFO: `/v3/users/1a2e2879196040d4b87e30740acde4a8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.513252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2e2879196040d4b87e30740acde4a8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.518666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.541385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c68c5e-083b-49e5-967f-7d0bc28f2b8c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.545051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-05c68c5e-083b-49e5-967f-7d0bc28f2b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.638780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2e2879196040d4b87e30740acde4a8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.640476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2e2879196040d4b87e30740acde4a8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.661974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c68c5e-083b-49e5-967f-7d0bc28f2b8c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:35.667714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2e2879196040d4b87e30740acde4a8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.670228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:35.671548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.672125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.673130 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.676898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.685008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2e2879196040d4b87e30740acde4a8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.685639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c7e74ded-25bd-4a6f-b3f6-5e15e3126f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2e2879196040d4b87e30740acde4a8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:35.710256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:35.712542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:35.715147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 842/1704] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:35 2022] DELETE /identity/v3/users/1a2e2879196040d4b87e30740acde4a8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:35.719501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad11c6-87df-4afa-b135-feda7e7de243 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:35.719801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad11c6-87df-4afa-b135-feda7e7de243 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:35.720087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad11c6-87df-4afa-b135-feda7e7de243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:35.723697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:35.732133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 863/1705] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:35.767139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c7ad11c6-87df-4afa-b135-feda7e7de243 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:35.773309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c7ad11c6-87df-4afa-b135-feda7e7de243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.928966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 843/1706] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:35.953991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:35.956060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:35.986642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11158a32-8dc3-4c6a-9448-e7bc1828505f service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.117205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8877dd7-095d-4226-8820-e6c36337a1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.118540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8877dd7-095d-4226-8820-e6c36337a1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.118540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8877dd7-095d-4226-8820-e6c36337a1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.118540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8877dd7-095d-4226-8820-e6c36337a1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.147902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8877dd7-095d-4226-8820-e6c36337a1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.149749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8877dd7-095d-4226-8820-e6c36337a1b0 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:36.171982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 864/1707] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:36.507228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec9039-6b65-4661-952a-44264ccb051d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.507986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec9039-6b65-4661-952a-44264ccb051d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.507986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec9039-6b65-4661-952a-44264ccb051d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.616842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f3ec9039-6b65-4661-952a-44264ccb051d None None] MFA Rules not processed for user `f865fb654778404a846ec2465eeef8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:36.622400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f3ec9039-6b65-4661-952a-44264ccb051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:36.802413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:36.822714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 844/1708] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:36.859020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8877dd7-095d-4226-8820-e6c36337a1b0 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.860575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c8877dd7-095d-4226-8820-e6c36337a1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:36.872930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec9039-6b65-4661-952a-44264ccb051d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:36.874406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f3ec9039-6b65-4661-952a-44264ccb051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:36.906091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec9039-6b65-4661-952a-44264ccb051d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:36.931832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:36.932964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:36.933303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:36.933590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] PATH_INFO: `/v3/projects/3abce31bcbc346cb8c2c3f73e79db5b6` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:36.935212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abce31bcbc346cb8c2c3f73e79db5b6)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:36.938338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.071323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abce31bcbc346cb8c2c3f73e79db5b6', 'request_id': 'req-5d754d21-c05a-4583-816e-0e85631485dd'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:37.124931 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abce31bcbc346cb8c2c3f73e79db5b6', 'request_id': 'req-5d754d21-c05a-4583-816e-0e85631485dd'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:37.173817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abce31bcbc346cb8c2c3f73e79db5b6', 'request_id': 'req-5d754d21-c05a-4583-816e-0e85631485dd'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:37.201894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8877dd7-095d-4226-8820-e6c36337a1b0 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.251729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] The token cache is being invalidate because project 3abce31bcbc346cb8c2c3f73e79db5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:37.252340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:37.255133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:37.271265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 845/1709] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:36 2022] DELETE /identity/v3/projects/3abce31bcbc346cb8c2c3f73e79db5b6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:37.272503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.278830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:37.412140 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.415521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.415996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.416459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.428985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:37.519864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d754d21-c05a-4583-816e-0e85631485dd admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.531994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:37.551740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b0e1b-62e7-4ce4-8daa-bc6af2e4cb61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.552735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b0e1b-62e7-4ce4-8daa-bc6af2e4cb61 service placement] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.553016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b0e1b-62e7-4ce4-8daa-bc6af2e4cb61 service placement] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.553292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b0e1b-62e7-4ce4-8daa-bc6af2e4cb61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.557926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-452b0e1b-62e7-4ce4-8daa-bc6af2e4cb61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:37.612479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b0e1b-62e7-4ce4-8daa-bc6af2e4cb61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.615493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b0e1b-62e7-4ce4-8daa-bc6af2e4cb61 service placement] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.621928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.623661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.646787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 846/1710] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:37.648497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951f6ef-d376-467c-ae82-aa0088fe67b2 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.649553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 865/1711] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 791 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:37.650643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:37.651203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951f6ef-d376-467c-ae82-aa0088fe67b2 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.652108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951f6ef-d376-467c-ae82-aa0088fe67b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.657209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:37.698428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1951f6ef-d376-467c-ae82-aa0088fe67b2 None None] MFA Rules not processed for user `66a5f1265c2f44fbb9a58d8d163b8460`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:37.705808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1951f6ef-d376-467c-ae82-aa0088fe67b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:37.890878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0db220-7a1c-4a2a-8540-cb0c017d97a7 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:37.898120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:37.900209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:37.900704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:37.902196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] PATH_INFO: `/v3/users/68a77570e7a7427daa2e323dc1445eca` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:37.903753 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a77570e7a7427daa2e323dc1445eca)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:37.912503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:37.914746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 847/1712] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:38.018968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a77570e7a7427daa2e323dc1445eca'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:38.056088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a77570e7a7427daa2e323dc1445eca'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:38.059282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a77570e7a7427daa2e323dc1445eca'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:38.083415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a77570e7a7427daa2e323dc1445eca'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:38.084708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a77570e7a7427daa2e323dc1445eca'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:38.132279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 866/1713] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:37 2022] DELETE /identity/v3/users/68a77570e7a7427daa2e323dc1445eca => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:39.190567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951f6ef-d376-467c-ae82-aa0088fe67b2 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:39.192092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1951f6ef-d376-467c-ae82-aa0088fe67b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:39.248643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951f6ef-d376-467c-ae82-aa0088fe67b2 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:39.284464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:39.430639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:39.431351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:39.431800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:39.432910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] PATH_INFO: `/v3/projects/650de4090126460993ddc24cc50041d7` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:39.434611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650de4090126460993ddc24cc50041d7)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:39.437017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:39.547830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650de4090126460993ddc24cc50041d7', 'request_id': 'req-ed4c32e4-9c5d-4189-a0cd-95a298846394'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.570197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650de4090126460993ddc24cc50041d7', 'request_id': 'req-ed4c32e4-9c5d-4189-a0cd-95a298846394'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.581255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650de4090126460993ddc24cc50041d7', 'request_id': 'req-ed4c32e4-9c5d-4189-a0cd-95a298846394'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.613043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] The token cache is being invalidate because project 650de4090126460993ddc24cc50041d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:39.613348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.614121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:39.624210 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 848/1714] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:39 2022] DELETE /identity/v3/projects/650de4090126460993ddc24cc50041d7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:39.626506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:39.628618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:39.664642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a8a83-dcbe-466a-ab8f-5f6e6b2051b1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:39.841623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:39.867045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:39.868009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:39.868009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:39.871430 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] PATH_INFO: `/v3/users/68ab494abf914a3d9c7c5cabafd06d0f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:39.874537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ab494abf914a3d9c7c5cabafd06d0f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:39.876647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:39.985160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ab494abf914a3d9c7c5cabafd06d0f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.023694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ab494abf914a3d9c7c5cabafd06d0f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.026750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ab494abf914a3d9c7c5cabafd06d0f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.044238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ab494abf914a3d9c7c5cabafd06d0f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.045652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-621d964c-6742-4af3-aa53-9e9321c24a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ab494abf914a3d9c7c5cabafd06d0f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.096123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 867/1715] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:39 2022] DELETE /identity/v3/users/68ab494abf914a3d9c7c5cabafd06d0f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:40.436582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:40.438412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:40.466418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c32e4-9c5d-4189-a0cd-95a298846394 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:40.626947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:40.627910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:40.628925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:40.629767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] PATH_INFO: `/v3/projects/39d9af8cde764969a2faafef6731d6ab` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:40.634242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d9af8cde764969a2faafef6731d6ab)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:40.642414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:40.732578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:40.735379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d9af8cde764969a2faafef6731d6ab', 'request_id': 'req-0478a3cc-8876-4f9a-a101-eb04e6006b49'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.758223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d9af8cde764969a2faafef6731d6ab', 'request_id': 'req-0478a3cc-8876-4f9a-a101-eb04e6006b49'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.767595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d9af8cde764969a2faafef6731d6ab', 'request_id': 'req-0478a3cc-8876-4f9a-a101-eb04e6006b49'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.815914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] The token cache is being invalidate because project 39d9af8cde764969a2faafef6731d6ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:40.824160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.824978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0478a3cc-8876-4f9a-a101-eb04e6006b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:40.827139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 849/1716] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:40 2022] DELETE /identity/v3/projects/39d9af8cde764969a2faafef6731d6ab => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:40.831908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5ba6-51ad-4f4a-a5c5-c6e50827b928 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:40.832661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5ba6-51ad-4f4a-a5c5-c6e50827b928 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:40.833177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5ba6-51ad-4f4a-a5c5-c6e50827b928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:40.883866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-0b4d5ba6-51ad-4f4a-a5c5-c6e50827b928 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:40.891043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0b4d5ba6-51ad-4f4a-a5c5-c6e50827b928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:41.151482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 868/1717] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:41.153524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27215-e325-4519-a4d8-cb81039238ec None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.154362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27215-e325-4519-a4d8-cb81039238ec None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.154659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27215-e325-4519-a4d8-cb81039238ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.203843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-a2b27215-e325-4519-a4d8-cb81039238ec None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:41.206212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a2b27215-e325-4519-a4d8-cb81039238ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:41.236436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 850/1718] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:41.240600 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d5ba6-51ad-4f4a-a5c5-c6e50827b928 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.263315 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d5ba6-51ad-4f4a-a5c5-c6e50827b928 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.282436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef50fc9-6f15-47dc-92ba-2e097d01cdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.286308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef50fc9-6f15-47dc-92ba-2e097d01cdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.286613 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef50fc9-6f15-47dc-92ba-2e097d01cdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.286887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef50fc9-6f15-47dc-92ba-2e097d01cdd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.287634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef50fc9-6f15-47dc-92ba-2e097d01cdd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:41.287944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef50fc9-6f15-47dc-92ba-2e097d01cdd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.312660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef50fc9-6f15-47dc-92ba-2e097d01cdd8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.369338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 869/1719] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:41.371136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b27215-e325-4519-a4d8-cb81039238ec None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.389038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b27215-e325-4519-a4d8-cb81039238ec None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.418077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced70f1e-7453-4352-a2c7-5042fcc18c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.418708 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced70f1e-7453-4352-a2c7-5042fcc18c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.418951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced70f1e-7453-4352-a2c7-5042fcc18c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.419233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced70f1e-7453-4352-a2c7-5042fcc18c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.419890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced70f1e-7453-4352-a2c7-5042fcc18c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.431767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced70f1e-7453-4352-a2c7-5042fcc18c6a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.573138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 851/1720] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:41 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:41.576448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef50fc9-6f15-47dc-92ba-2e097d01cdd8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.588322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef50fc9-6f15-47dc-92ba-2e097d01cdd8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.750301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e8ec5-bf4b-4456-87a8-5fc2b1d27a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.752511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e8ec5-bf4b-4456-87a8-5fc2b1d27a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.753067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e8ec5-bf4b-4456-87a8-5fc2b1d27a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.753533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e8ec5-bf4b-4456-87a8-5fc2b1d27a2a admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.754390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e8ec5-bf4b-4456-87a8-5fc2b1d27a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.760148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e8ec5-bf4b-4456-87a8-5fc2b1d27a2a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.817953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:41.840391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 870/1721] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:41 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:41.844148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced70f1e-7453-4352-a2c7-5042fcc18c6a admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:41.859002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced70f1e-7453-4352-a2c7-5042fcc18c6a admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:41.868434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097da0d-d8c7-46f5-8b54-248dee0669b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:41.869401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097da0d-d8c7-46f5-8b54-248dee0669b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.869401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097da0d-d8c7-46f5-8b54-248dee0669b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.869643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097da0d-d8c7-46f5-8b54-248dee0669b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.877023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915521c3-33b9-40b3-93f4-d3c7a5aec22d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:41.877651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915521c3-33b9-40b3-93f4-d3c7a5aec22d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:41.878077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915521c3-33b9-40b3-93f4-d3c7a5aec22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:41.904675 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097da0d-d8c7-46f5-8b54-248dee0669b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:41.913062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097da0d-d8c7-46f5-8b54-248dee0669b9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:41.968901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 852/1722] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:41.972019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097da0d-d8c7-46f5-8b54-248dee0669b9 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.012042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097da0d-d8c7-46f5-8b54-248dee0669b9 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:42.043302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfba3fb-9a1d-43c0-84c4-ca23bd5a43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:42.044055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfba3fb-9a1d-43c0-84c4-ca23bd5a43dd admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.044188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfba3fb-9a1d-43c0-84c4-ca23bd5a43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.044542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfba3fb-9a1d-43c0-84c4-ca23bd5a43dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.045107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfba3fb-9a1d-43c0-84c4-ca23bd5a43dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:42.046899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfba3fb-9a1d-43c0-84c4-ca23bd5a43dd admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:42.059719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 853/1723] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:42.064182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfba3fb-9a1d-43c0-84c4-ca23bd5a43dd admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.094192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-915521c3-33b9-40b3-93f4-d3c7a5aec22d None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:42.094441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfba3fb-9a1d-43c0-84c4-ca23bd5a43dd admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:42.099094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-915521c3-33b9-40b3-93f4-d3c7a5aec22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:42.116689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ed3b9-7dde-41dc-aff5-4d9f45888f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:42.117401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ed3b9-7dde-41dc-aff5-4d9f45888f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.117682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ed3b9-7dde-41dc-aff5-4d9f45888f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.117961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ed3b9-7dde-41dc-aff5-4d9f45888f05 admin admin] PATH_INFO: `/v3/projects/c90f44f59c5048c390ab10fec1fd8814/users/71884be1afd44d68a1d82a745f9a704c/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.160642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ed3b9-7dde-41dc-aff5-4d9f45888f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90f44f59c5048c390ab10fec1fd8814, user_id=71884be1afd44d68a1d82a745f9a704c, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:42.166276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ed3b9-7dde-41dc-aff5-4d9f45888f05 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:42.209056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 854/1724] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:42 2022] PUT /identity/v3/projects/c90f44f59c5048c390ab10fec1fd8814/users/71884be1afd44d68a1d82a745f9a704c/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:42.219427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd3cc-2464-4a42-a84b-d0f5c4defaf4 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.220890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd3cc-2464-4a42-a84b-d0f5c4defaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.221961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdd3cc-2464-4a42-a84b-d0f5c4defaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:42.346599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b5bdd3cc-2464-4a42-a84b-d0f5c4defaf4 None None] MFA Rules not processed for user `71884be1afd44d68a1d82a745f9a704c`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:42.347885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b5bdd3cc-2464-4a42-a84b-d0f5c4defaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:42.349737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 871/1725] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:42.634831 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 855/1726] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:42.648914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915521c3-33b9-40b3-93f4-d3c7a5aec22d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.652286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-915521c3-33b9-40b3-93f4-d3c7a5aec22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:42.752491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdd3cc-2464-4a42-a84b-d0f5c4defaf4 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:42.753976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b5bdd3cc-2464-4a42-a84b-d0f5c4defaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:42.797670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915521c3-33b9-40b3-93f4-d3c7a5aec22d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:42.962660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e26d1-51b1-478c-a86f-13db2d760373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:42.964493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e26d1-51b1-478c-a86f-13db2d760373 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:42.965178 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e26d1-51b1-478c-a86f-13db2d760373 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:42.965829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e26d1-51b1-478c-a86f-13db2d760373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:43.003954 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e26d1-51b1-478c-a86f-13db2d760373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:43.011769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e26d1-51b1-478c-a86f-13db2d760373 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:43.032522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 872/1727] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:43.033980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f318ad9-056a-4bde-883d-18bc3aa8be2d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:43.034272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f318ad9-056a-4bde-883d-18bc3aa8be2d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:43.034560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f318ad9-056a-4bde-883d-18bc3aa8be2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:43.101142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:43.121163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7f318ad9-056a-4bde-883d-18bc3aa8be2d None None] MFA Rules not processed for user `794b4a8edbbf431abbd20bab461e802f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:43.125190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7f318ad9-056a-4bde-883d-18bc3aa8be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:43.169508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:43.288064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdd3cc-2464-4a42-a84b-d0f5c4defaf4 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:43.311503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7cbd-bfc5-4ea9-91b8-4592f930995b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:43.312423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7cbd-bfc5-4ea9-91b8-4592f930995b service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:43.312946 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7cbd-bfc5-4ea9-91b8-4592f930995b service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:43.315764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7cbd-bfc5-4ea9-91b8-4592f930995b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:43.420949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 873/1728] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:43.420949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f318ad9-056a-4bde-883d-18bc3aa8be2d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:43.420949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7f318ad9-056a-4bde-883d-18bc3aa8be2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:43.450149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d7cbd-bfc5-4ea9-91b8-4592f930995b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:43.452608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d7cbd-bfc5-4ea9-91b8-4592f930995b service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:43.490898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 856/1729] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:40:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:40:43.497156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7cbd-bfc5-4ea9-91b8-4592f930995b service swift] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:43.501287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a87d7cbd-bfc5-4ea9-91b8-4592f930995b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:43.517372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f318ad9-056a-4bde-883d-18bc3aa8be2d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:43.527749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:43.529279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:43.529782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:43.531877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] PATH_INFO: `/v3/projects/487b36aab10546438ff3877693d52d4f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:43.533620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487b36aab10546438ff3877693d52d4f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:43.536435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:43.558881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7cbd-bfc5-4ea9-91b8-4592f930995b service swift] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:43.586328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb761cf-cd9f-41fd-9130-a3d70da4e8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:43.587051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb761cf-cd9f-41fd-9130-a3d70da4e8ad admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:43.587335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb761cf-cd9f-41fd-9130-a3d70da4e8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:43.587652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb761cf-cd9f-41fd-9130-a3d70da4e8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:43.588543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb761cf-cd9f-41fd-9130-a3d70da4e8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:43.596485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb761cf-cd9f-41fd-9130-a3d70da4e8ad admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:43.676443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487b36aab10546438ff3877693d52d4f', 'request_id': 'req-21773a6d-6005-4510-aee4-b303a09a1f34'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:43.691769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487b36aab10546438ff3877693d52d4f', 'request_id': 'req-21773a6d-6005-4510-aee4-b303a09a1f34'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:43.704873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487b36aab10546438ff3877693d52d4f', 'request_id': 'req-21773a6d-6005-4510-aee4-b303a09a1f34'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:43.742728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] The token cache is being invalidate because project 487b36aab10546438ff3877693d52d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:43.748842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:43.752191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-21773a6d-6005-4510-aee4-b303a09a1f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:43.762275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 874/1730] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:43 2022] DELETE /identity/v3/projects/487b36aab10546438ff3877693d52d4f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:43.774449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024fd66-90ca-4765-bc23-877467ca3724 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:43.774901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024fd66-90ca-4765-bc23-877467ca3724 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:43.775316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024fd66-90ca-4765-bc23-877467ca3724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:43.775484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 857/1731] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:43 2022] POST /identity/v3/projects => generated 405 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:43.777052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb761cf-cd9f-41fd-9130-a3d70da4e8ad admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:43.792151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-fdb761cf-cd9f-41fd-9130-a3d70da4e8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:43.884315 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d024fd66-90ca-4765-bc23-877467ca3724 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:43.885760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d024fd66-90ca-4765-bc23-877467ca3724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:44.021914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb761cf-cd9f-41fd-9130-a3d70da4e8ad admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:44.046452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5007057-9810-4dad-9d03-df975603d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:44.046452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5007057-9810-4dad-9d03-df975603d138 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:44.046452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5007057-9810-4dad-9d03-df975603d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:44.046452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5007057-9810-4dad-9d03-df975603d138 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:44.046875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5007057-9810-4dad-9d03-df975603d138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:44.068086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5007057-9810-4dad-9d03-df975603d138 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:44.158385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:44.200628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 858/1732] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:43 2022] POST /identity/v3/users => generated 309 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:44.202684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5007057-9810-4dad-9d03-df975603d138 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:44.244812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5007057-9810-4dad-9d03-df975603d138 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:44.262365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc79a3-5e2b-4556-9a9c-eac3c2f9e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:44.263461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc79a3-5e2b-4556-9a9c-eac3c2f9e4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:44.263986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc79a3-5e2b-4556-9a9c-eac3c2f9e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:44.264465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc79a3-5e2b-4556-9a9c-eac3c2f9e4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:44.265408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc79a3-5e2b-4556-9a9c-eac3c2f9e4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:44.267371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc79a3-5e2b-4556-9a9c-eac3c2f9e4a9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:44.284007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 875/1733] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:44.303547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 859/1734] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:44.305176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024fd66-90ca-4765-bc23-877467ca3724 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:44.305962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6890766-64b6-40b4-bf53-dca064fd6418 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:44.309404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6890766-64b6-40b4-bf53-dca064fd6418 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:44.309806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6890766-64b6-40b4-bf53-dca064fd6418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:44.346304 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024fd66-90ca-4765-bc23-877467ca3724 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:44.356586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff288d-31bb-4605-8620-ac69ebd628f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:44.357385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff288d-31bb-4605-8620-ac69ebd628f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:44.357661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff288d-31bb-4605-8620-ac69ebd628f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:44.359515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff288d-31bb-4605-8620-ac69ebd628f2 admin admin] PATH_INFO: `/v3/projects/fdc64e71788b40e88bf06b4e3dca0b70/users/3b4a84b27ce241a6985bb1e26001c74d/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:44.401867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f6890766-64b6-40b4-bf53-dca064fd6418 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:44.405888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f6890766-64b6-40b4-bf53-dca064fd6418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:44.438704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 860/1735] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:44.441003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff288d-31bb-4605-8620-ac69ebd628f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc64e71788b40e88bf06b4e3dca0b70, user_id=3b4a84b27ce241a6985bb1e26001c74d, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:44.441198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6890766-64b6-40b4-bf53-dca064fd6418 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:44.449466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff288d-31bb-4605-8620-ac69ebd628f2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:44.475998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6890766-64b6-40b4-bf53-dca064fd6418 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:44.496045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809d49b-216a-4b04-8dec-5614de071dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:44.496760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809d49b-216a-4b04-8dec-5614de071dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:44.497050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809d49b-216a-4b04-8dec-5614de071dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:44.497319 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809d49b-216a-4b04-8dec-5614de071dd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:44.498087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809d49b-216a-4b04-8dec-5614de071dd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:44.498459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809d49b-216a-4b04-8dec-5614de071dd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:44.500520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809d49b-216a-4b04-8dec-5614de071dd7 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:44.506865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 876/1736] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:44 2022] PUT /identity/v3/projects/fdc64e71788b40e88bf06b4e3dca0b70/users/3b4a84b27ce241a6985bb1e26001c74d/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:44.515516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff288d-31bb-4605-8620-ac69ebd628f2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:44.539868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 861/1737] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:44.547723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809d49b-216a-4b04-8dec-5614de071dd7 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:44.569622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809d49b-216a-4b04-8dec-5614de071dd7 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:44.582137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:44.805449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff288d-31bb-4605-8620-ac69ebd628f2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:44.811959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a71df-3bdd-4862-b485-66cdc6f78354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:44.815171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a71df-3bdd-4862-b485-66cdc6f78354 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:44.817262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a71df-3bdd-4862-b485-66cdc6f78354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:44.817741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a71df-3bdd-4862-b485-66cdc6f78354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:44.818868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a71df-3bdd-4862-b485-66cdc6f78354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:44.822843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf0ebb-77bc-475e-8224-2698d985abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:44.824057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf0ebb-77bc-475e-8224-2698d985abfd admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:44.826432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf0ebb-77bc-475e-8224-2698d985abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:44.827037 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf0ebb-77bc-475e-8224-2698d985abfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:44.830168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf0ebb-77bc-475e-8224-2698d985abfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:44.833272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf0ebb-77bc-475e-8224-2698d985abfd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:44.862613 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a71df-3bdd-4862-b485-66cdc6f78354 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:44.884072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 877/1738] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:44.888677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf0ebb-77bc-475e-8224-2698d985abfd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:44.921276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf0ebb-77bc-475e-8224-2698d985abfd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:44.937417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58330c-ad10-4807-bee0-6976ee36edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:44.938781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58330c-ad10-4807-bee0-6976ee36edc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:44.939373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58330c-ad10-4807-bee0-6976ee36edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:44.939898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58330c-ad10-4807-bee0-6976ee36edc4 admin admin] PATH_INFO: `/v3/projects/fdc64e71788b40e88bf06b4e3dca0b70/users/3b4a84b27ce241a6985bb1e26001c74d/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:44.949409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58330c-ad10-4807-bee0-6976ee36edc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc64e71788b40e88bf06b4e3dca0b70, user_id=3b4a84b27ce241a6985bb1e26001c74d, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:44.959247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58330c-ad10-4807-bee0-6976ee36edc4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:44.960787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 862/1739] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:44 2022] POST /identity/v3/projects => generated 371 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:44.969740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a71df-3bdd-4862-b485-66cdc6f78354 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:44.995725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 878/1740] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:44 2022] PUT /identity/v3/projects/fdc64e71788b40e88bf06b4e3dca0b70/users/3b4a84b27ce241a6985bb1e26001c74d/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:40:45.048934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ffcfb-1ee0-4c33-9cbb-5267dfe6ed82 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.049236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ffcfb-1ee0-4c33-9cbb-5267dfe6ed82 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.049518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ffcfb-1ee0-4c33-9cbb-5267dfe6ed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.157164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b26ffcfb-1ee0-4c33-9cbb-5267dfe6ed82 None None] MFA Rules not processed for user `91137d4fc46f401aa969752a5adf176f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:45.157164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b26ffcfb-1ee0-4c33-9cbb-5267dfe6ed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:45.424348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a71df-3bdd-4862-b485-66cdc6f78354 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:45.514203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 879/1741] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:45.535964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ffcfb-1ee0-4c33-9cbb-5267dfe6ed82 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:45.541252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b26ffcfb-1ee0-4c33-9cbb-5267dfe6ed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:45.627746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c313-8e28-4604-9f69-e71d861227f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:45.631197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c313-8e28-4604-9f69-e71d861227f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.631650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c313-8e28-4604-9f69-e71d861227f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.632151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c313-8e28-4604-9f69-e71d861227f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.634693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68c313-8e28-4604-9f69-e71d861227f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:45.637135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68c313-8e28-4604-9f69-e71d861227f5 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:45.639712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:45.732123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 863/1742] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:44 2022] POST /identity/v3/users => generated 286 bytes in 758 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:45.736582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c313-8e28-4604-9f69-e71d861227f5 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:45.777952 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c313-8e28-4604-9f69-e71d861227f5 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:45.788948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706b688-f2e4-4317-83ee-62882bc0c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:45.789910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b688-f2e4-4317-83ee-62882bc0c9bc admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.790239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b688-f2e4-4317-83ee-62882bc0c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.790609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706b688-f2e4-4317-83ee-62882bc0c9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.793732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706b688-f2e4-4317-83ee-62882bc0c9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:45.797742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706b688-f2e4-4317-83ee-62882bc0c9bc admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:45.817830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ffcfb-1ee0-4c33-9cbb-5267dfe6ed82 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:45.833109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 864/1743] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:45.842191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469e47c-161d-44eb-a72a-d53ee7287276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:45.842867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469e47c-161d-44eb-a72a-d53ee7287276 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.843175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469e47c-161d-44eb-a72a-d53ee7287276 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.843642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469e47c-161d-44eb-a72a-d53ee7287276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.844571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706b688-f2e4-4317-83ee-62882bc0c9bc admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:45.880540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706b688-f2e4-4317-83ee-62882bc0c9bc admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:45.882643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469e47c-161d-44eb-a72a-d53ee7287276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:45.884342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469e47c-161d-44eb-a72a-d53ee7287276 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:45.907713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3840a-06ef-4971-8f01-b716860bbba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:45.908470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3840a-06ef-4971-8f01-b716860bbba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.908785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3840a-06ef-4971-8f01-b716860bbba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.909081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3840a-06ef-4971-8f01-b716860bbba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.909823 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3840a-06ef-4971-8f01-b716860bbba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:45.911510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3840a-06ef-4971-8f01-b716860bbba4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:45.925321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 880/1744] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:45.940546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 865/1745] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:45.942089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469e47c-161d-44eb-a72a-d53ee7287276 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:45.958167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469e47c-161d-44eb-a72a-d53ee7287276 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:45.966911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6578758-42c8-4924-a583-211d4412215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:45.968343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578758-42c8-4924-a583-211d4412215d admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:45.969336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578758-42c8-4924-a583-211d4412215d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:45.969899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578758-42c8-4924-a583-211d4412215d admin admin] PATH_INFO: `/v3/projects/69bd99c9cf0945e3a48f62d679e999d6/users/1cee8d97229f421899c131dc675609fa/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:45.991081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6578758-42c8-4924-a583-211d4412215d admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bd99c9cf0945e3a48f62d679e999d6, user_id=1cee8d97229f421899c131dc675609fa, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:45.995438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6578758-42c8-4924-a583-211d4412215d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:46.030843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 881/1746] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:45 2022] PUT /identity/v3/projects/69bd99c9cf0945e3a48f62d679e999d6/users/1cee8d97229f421899c131dc675609fa/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:46.032419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa8cc-6b2f-40a3-b206-191b95fa6b2b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:46.032793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa8cc-6b2f-40a3-b206-191b95fa6b2b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:46.033098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa8cc-6b2f-40a3-b206-191b95fa6b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:46.081764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-471aa8cc-6b2f-40a3-b206-191b95fa6b2b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:46.085615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-471aa8cc-6b2f-40a3-b206-191b95fa6b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:46.098482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:46.218902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f13c-ac60-442e-a6b0-7abf5e700bc1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:46.219578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f13c-ac60-442e-a6b0-7abf5e700bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:46.220134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f13c-ac60-442e-a6b0-7abf5e700bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:46.370171 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7e44f13c-ac60-442e-a6b0-7abf5e700bc1 None None] MFA Rules not processed for user `b18686529ecb4b5db2bd0648081c9c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:46.373229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7e44f13c-ac60-442e-a6b0-7abf5e700bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:46.444227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 866/1747] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:46.502856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aa8cc-6b2f-40a3-b206-191b95fa6b2b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:46.506828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-471aa8cc-6b2f-40a3-b206-191b95fa6b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:46.659658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 882/1748] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:46.676218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f882c-31e5-4ef8-a685-9b81bd890ce4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:46.676693 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f882c-31e5-4ef8-a685-9b81bd890ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:46.677138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f882c-31e5-4ef8-a685-9b81bd890ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:46.704381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aa8cc-6b2f-40a3-b206-191b95fa6b2b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:46.717196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc173882-b658-4d97-bf45-9bb0b262e81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:46.717898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc173882-b658-4d97-bf45-9bb0b262e81f service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:46.718315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc173882-b658-4d97-bf45-9bb0b262e81f service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:46.718623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc173882-b658-4d97-bf45-9bb0b262e81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:46.724194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9e6f882c-31e5-4ef8-a685-9b81bd890ce4 None None] MFA Rules not processed for user `b18686529ecb4b5db2bd0648081c9c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:46.728392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9e6f882c-31e5-4ef8-a685-9b81bd890ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:46.743937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc173882-b658-4d97-bf45-9bb0b262e81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:46.752721 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc173882-b658-4d97-bf45-9bb0b262e81f service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:46.780401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 883/1749] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:46.789927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 867/1750] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:46.791125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f882c-31e5-4ef8-a685-9b81bd890ce4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:47.016899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f882c-31e5-4ef8-a685-9b81bd890ce4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:47.032758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e152b1-cb76-406e-bbe4-a895500513db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:47.036970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e152b1-cb76-406e-bbe4-a895500513db service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:47.037675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e152b1-cb76-406e-bbe4-a895500513db service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:47.038351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e152b1-cb76-406e-bbe4-a895500513db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:47.068015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e152b1-cb76-406e-bbe4-a895500513db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:47.077015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e152b1-cb76-406e-bbe4-a895500513db service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:47.101009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 884/1751] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:48.936827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb73f6-13e7-42d4-add8-aab7e72ea293 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:48.937417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb73f6-13e7-42d4-add8-aab7e72ea293 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:48.938113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb73f6-13e7-42d4-add8-aab7e72ea293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.022585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b6cb73f6-13e7-42d4-add8-aab7e72ea293 None None] MFA Rules not processed for user `f865fb654778404a846ec2465eeef8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:49.033650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b6cb73f6-13e7-42d4-add8-aab7e72ea293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.228307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 868/1752] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:49.403342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15f8bd-6e58-4ba8-bdbc-f327e3174e16 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.404544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15f8bd-6e58-4ba8-bdbc-f327e3174e16 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.405163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15f8bd-6e58-4ba8-bdbc-f327e3174e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.440092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:49.504348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7f15f8bd-6e58-4ba8-bdbc-f327e3174e16 None None] MFA Rules not processed for user `a7a82c500de745c0b55df44b7f641706`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:49.512022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7f15f8bd-6e58-4ba8-bdbc-f327e3174e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.568809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 885/1753] 10.222.0.93 () {58 vars in 1015 bytes} [Fri Aug 26 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:49.832519 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb73f6-13e7-42d4-add8-aab7e72ea293 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:49.834618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b6cb73f6-13e7-42d4-add8-aab7e72ea293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:49.874013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb73f6-13e7-42d4-add8-aab7e72ea293 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:49.894051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14944662-d1fc-478d-970a-6547ecb57474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:49.897435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14944662-d1fc-478d-970a-6547ecb57474 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:49.898410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14944662-d1fc-478d-970a-6547ecb57474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:49.899150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14944662-d1fc-478d-970a-6547ecb57474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:49.937297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14944662-d1fc-478d-970a-6547ecb57474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:49.938989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14944662-d1fc-478d-970a-6547ecb57474 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:49.975439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 869/1754] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:51.191864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b261c-ff7e-4701-814b-18fa3f8e35f3 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.193497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b261c-ff7e-4701-814b-18fa3f8e35f3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.194663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b261c-ff7e-4701-814b-18fa3f8e35f3 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.197378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 886/1755] 10.222.0.89 () {54 vars in 912 bytes} [Fri Aug 26 15:40:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:51.224125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0578f55-d844-4c7c-a6c1-b9c02f0a29b0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.225037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0578f55-d844-4c7c-a6c1-b9c02f0a29b0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.225539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0578f55-d844-4c7c-a6c1-b9c02f0a29b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.395500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-d0578f55-d844-4c7c-a6c1-b9c02f0a29b0 None None] MFA Rules not processed for user `a7a82c500de745c0b55df44b7f641706`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:51.415347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d0578f55-d844-4c7c-a6c1-b9c02f0a29b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:51.475391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 870/1756] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:40:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:51.600614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b261c-ff7e-4701-814b-18fa3f8e35f3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:51.651823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b261c-ff7e-4701-814b-18fa3f8e35f3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:51.704790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bd149-4452-404b-a114-96f0f68109f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:51.707463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd149-4452-404b-a114-96f0f68109f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:51.708394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd149-4452-404b-a114-96f0f68109f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:51.711699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bd149-4452-404b-a114-96f0f68109f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:51.789586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd149-4452-404b-a114-96f0f68109f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:51.801849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bd149-4452-404b-a114-96f0f68109f2 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:51.868151 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 887/1757] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:40:52.177680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0578f55-d844-4c7c-a6c1-b9c02f0a29b0 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:52.179859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d0578f55-d844-4c7c-a6c1-b9c02f0a29b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:52.212643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0578f55-d844-4c7c-a6c1-b9c02f0a29b0 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:52.228676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:52.230655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.234406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.236275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] PATH_INFO: `/v3/users/71884be1afd44d68a1d82a745f9a704c` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.242620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71884be1afd44d68a1d82a745f9a704c)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:52.248518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:52.351895 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:52.425579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71884be1afd44d68a1d82a745f9a704c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:52.428795 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71884be1afd44d68a1d82a745f9a704c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:52.472873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71884be1afd44d68a1d82a745f9a704c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:52.494595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71884be1afd44d68a1d82a745f9a704c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:52.497704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71884be1afd44d68a1d82a745f9a704c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:52.553527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 871/1758] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:52 2022] DELETE /identity/v3/users/71884be1afd44d68a1d82a745f9a704c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:52.553986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809e695-badc-48d0-914e-8ce55773840d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:52.554822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809e695-badc-48d0-914e-8ce55773840d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:52.554822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809e695-badc-48d0-914e-8ce55773840d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:52.613907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7809e695-badc-48d0-914e-8ce55773840d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:52.622560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7809e695-badc-48d0-914e-8ce55773840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:53.091246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 888/1759] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:53.565651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:53.567301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:53.766012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab6a4d-3071-4eff-96d4-0ae41b9d45e0 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:53.772685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1490-1446-4505-bf6f-dbcaf20688f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:53.773637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1490-1446-4505-bf6f-dbcaf20688f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:53.773976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1490-1446-4505-bf6f-dbcaf20688f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:53.774409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1490-1446-4505-bf6f-dbcaf20688f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:53.798320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f1490-1446-4505-bf6f-dbcaf20688f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:53.801327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f1490-1446-4505-bf6f-dbcaf20688f8 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:53.833013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 872/1760] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:54.014392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a642-156a-496e-9ec7-3f16cbe5b079 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:54.015482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a642-156a-496e-9ec7-3f16cbe5b079 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:54.015855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a642-156a-496e-9ec7-3f16cbe5b079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:54.145841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-8825a642-156a-496e-9ec7-3f16cbe5b079 None None] MFA Rules not processed for user `e56d4b78d51b4a81842f5724aaff7f85`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:54.156486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8825a642-156a-496e-9ec7-3f16cbe5b079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:54.318108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd03d4-e0b3-43ee-9279-e1a81aba047b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:54.318653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd03d4-e0b3-43ee-9279-e1a81aba047b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:54.319208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd03d4-e0b3-43ee-9279-e1a81aba047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:54.397927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-58bd03d4-e0b3-43ee-9279-e1a81aba047b None None] MFA Rules not processed for user `3b4a84b27ce241a6985bb1e26001c74d`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:54.404652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-58bd03d4-e0b3-43ee-9279-e1a81aba047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:54.409591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 889/1761] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:54.610358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 873/1762] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:54 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:55.433195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a642-156a-496e-9ec7-3f16cbe5b079 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:55.435541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8825a642-156a-496e-9ec7-3f16cbe5b079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:55.678925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a642-156a-496e-9ec7-3f16cbe5b079 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:55.694399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd10e-1816-4781-a5db-70cdbcd94cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:55.695492 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd10e-1816-4781-a5db-70cdbcd94cfb service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:55.697733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd10e-1816-4781-a5db-70cdbcd94cfb service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:55.698354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd10e-1816-4781-a5db-70cdbcd94cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:55.720544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bd10e-1816-4781-a5db-70cdbcd94cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:55.722674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bd10e-1816-4781-a5db-70cdbcd94cfb service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:55.732003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:55.757407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 890/1763] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:56.018075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091e82-d858-4aa3-b7c8-44bebbb463da None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.018634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091e82-d858-4aa3-b7c8-44bebbb463da None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.018833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f091e82-d858-4aa3-b7c8-44bebbb463da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.120213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1f091e82-d858-4aa3-b7c8-44bebbb463da None None] MFA Rules not processed for user `1cee8d97229f421899c131dc675609fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:56.120213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1f091e82-d858-4aa3-b7c8-44bebbb463da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.191736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:56.325656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd10e-1816-4781-a5db-70cdbcd94cfb service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.327402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a06bd10e-1816-4781-a5db-70cdbcd94cfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.330012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 874/1764] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:56.354898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd10e-1816-4781-a5db-70cdbcd94cfb service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.363947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78ad35-d80b-4da0-9549-232f7f3f5a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.365021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78ad35-d80b-4da0-9549-232f7f3f5a45 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.365559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78ad35-d80b-4da0-9549-232f7f3f5a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.366063 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78ad35-d80b-4da0-9549-232f7f3f5a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.367000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78ad35-d80b-4da0-9549-232f7f3f5a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.369681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78ad35-d80b-4da0-9549-232f7f3f5a45 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.431858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091e82-d858-4aa3-b7c8-44bebbb463da None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.436372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 891/1765] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:56 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:40:56.437936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78ad35-d80b-4da0-9549-232f7f3f5a45 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:56.444113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3d78ad35-d80b-4da0-9549-232f7f3f5a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:56.464103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f091e82-d858-4aa3-b7c8-44bebbb463da None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.717742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78ad35-d80b-4da0-9549-232f7f3f5a45 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:56.744019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.745600 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.746053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.750407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] PATH_INFO: `/v3/projects/c90f44f59c5048c390ab10fec1fd8814` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.759729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c90f44f59c5048c390ab10fec1fd8814)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.765136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.837012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83433be3-f0f5-4daa-ad5d-3602f5c09061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:56.838046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83433be3-f0f5-4daa-ad5d-3602f5c09061 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:56.838565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83433be3-f0f5-4daa-ad5d-3602f5c09061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:56.839094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83433be3-f0f5-4daa-ad5d-3602f5c09061 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:56.840584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83433be3-f0f5-4daa-ad5d-3602f5c09061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:56.844101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83433be3-f0f5-4daa-ad5d-3602f5c09061 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:56.942387 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 875/1766] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:56 2022] POST /identity/v3/users => generated 292 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:56.950048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83433be3-f0f5-4daa-ad5d-3602f5c09061 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:57.016667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90f44f59c5048c390ab10fec1fd8814', 'request_id': 'req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.019689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83433be3-f0f5-4daa-ad5d-3602f5c09061 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:57.045862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90f44f59c5048c390ab10fec1fd8814', 'request_id': 'req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.059613 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90f44f59c5048c390ab10fec1fd8814', 'request_id': 'req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.112745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] The token cache is being invalidate because project c90f44f59c5048c390ab10fec1fd8814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:40:57.113046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.113780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d1730bd6-f884-43a8-8e0a-faf6009c2ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:57.118013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 892/1767] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:40:56 2022] DELETE /identity/v3/projects/c90f44f59c5048c390ab10fec1fd8814 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:57.126144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb05b25-76df-46d5-adad-d20678858515 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.126604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb05b25-76df-46d5-adad-d20678858515 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.132277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb05b25-76df-46d5-adad-d20678858515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.178279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6fb05b25-76df-46d5-adad-d20678858515 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:57.179569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6fb05b25-76df-46d5-adad-d20678858515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:57.278809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a991f8-1fb2-4099-8764-4be53b8c5765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:57.282470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a991f8-1fb2-4099-8764-4be53b8c5765 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.282944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a991f8-1fb2-4099-8764-4be53b8c5765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.286139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a991f8-1fb2-4099-8764-4be53b8c5765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.287435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a991f8-1fb2-4099-8764-4be53b8c5765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:57.290599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a991f8-1fb2-4099-8764-4be53b8c5765 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:57.345569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 876/1768] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:57.347185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a991f8-1fb2-4099-8764-4be53b8c5765 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:57.352907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b0a991f8-1fb2-4099-8764-4be53b8c5765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:57.389961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a991f8-1fb2-4099-8764-4be53b8c5765 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:57.411436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86969774-3c68-4586-9b8b-dbaae4f78712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:57.412162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86969774-3c68-4586-9b8b-dbaae4f78712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.412452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86969774-3c68-4586-9b8b-dbaae4f78712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.412732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86969774-3c68-4586-9b8b-dbaae4f78712 admin admin] PATH_INFO: `/v3/projects/36423f5e5d00416290468afcca9ecfb4/users/af9ccd20d4224d7f8e61f02e19a053bb/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.437497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 893/1769] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:57.475921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12213e7e-36f6-4931-9e2a-a51e2cb57962 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.476730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12213e7e-36f6-4931-9e2a-a51e2cb57962 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.478646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12213e7e-36f6-4931-9e2a-a51e2cb57962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.480766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86969774-3c68-4586-9b8b-dbaae4f78712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36423f5e5d00416290468afcca9ecfb4, user_id=af9ccd20d4224d7f8e61f02e19a053bb, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:57.488261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86969774-3c68-4586-9b8b-dbaae4f78712 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:57.518246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 877/1770] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:57 2022] PUT /identity/v3/projects/36423f5e5d00416290468afcca9ecfb4/users/af9ccd20d4224d7f8e61f02e19a053bb/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:57.523449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86969774-3c68-4586-9b8b-dbaae4f78712 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:57.534328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:57.573658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-12213e7e-36f6-4931-9e2a-a51e2cb57962 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:57.581034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-12213e7e-36f6-4931-9e2a-a51e2cb57962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:57.608966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:57.685333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86969774-3c68-4586-9b8b-dbaae4f78712 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:57.694267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf883-4b11-4e03-bfa5-1f65ed809fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:57.695201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf883-4b11-4e03-bfa5-1f65ed809fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.696110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf883-4b11-4e03-bfa5-1f65ed809fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.697478 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf883-4b11-4e03-bfa5-1f65ed809fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.699059 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf883-4b11-4e03-bfa5-1f65ed809fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:57.712000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf883-4b11-4e03-bfa5-1f65ed809fe7 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:57.751379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 878/1771] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:57.754034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf883-4b11-4e03-bfa5-1f65ed809fe7 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:57.780594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf883-4b11-4e03-bfa5-1f65ed809fe7 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:57.802997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639a96b-0aa2-4506-95f4-353c56e997cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:57.803783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639a96b-0aa2-4506-95f4-353c56e997cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:57.804071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639a96b-0aa2-4506-95f4-353c56e997cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:57.804357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639a96b-0aa2-4506-95f4-353c56e997cc admin admin] PATH_INFO: `/v3/projects/36423f5e5d00416290468afcca9ecfb4/users/af9ccd20d4224d7f8e61f02e19a053bb/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:57.807833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639a96b-0aa2-4506-95f4-353c56e997cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=36423f5e5d00416290468afcca9ecfb4, user_id=af9ccd20d4224d7f8e61f02e19a053bb, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:57.812541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 894/1772] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:57.816669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12213e7e-36f6-4931-9e2a-a51e2cb57962 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:57.817215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639a96b-0aa2-4506-95f4-353c56e997cc admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:57.843853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12213e7e-36f6-4931-9e2a-a51e2cb57962 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:57.865291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 879/1773] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:57 2022] PUT /identity/v3/projects/36423f5e5d00416290468afcca9ecfb4/users/af9ccd20d4224d7f8e61f02e19a053bb/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:58.021802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5247ed-22e7-4e44-a9bd-77e6b2187910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.022912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5247ed-22e7-4e44-a9bd-77e6b2187910 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.023773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5247ed-22e7-4e44-a9bd-77e6b2187910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.024401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5247ed-22e7-4e44-a9bd-77e6b2187910 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.025318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5247ed-22e7-4e44-a9bd-77e6b2187910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:40:58.025847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5247ed-22e7-4e44-a9bd-77e6b2187910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.028560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5247ed-22e7-4e44-a9bd-77e6b2187910 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.059464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 895/1774] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:40:58.067965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639a96b-0aa2-4506-95f4-353c56e997cc admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.107084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639a96b-0aa2-4506-95f4-353c56e997cc admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.120369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fcff3-4c42-4176-8177-b91610a73d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.121507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fcff3-4c42-4176-8177-b91610a73d68 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.123804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fcff3-4c42-4176-8177-b91610a73d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.124287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fcff3-4c42-4176-8177-b91610a73d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.126708 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fcff3-4c42-4176-8177-b91610a73d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.129615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fcff3-4c42-4176-8177-b91610a73d68 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.216098 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 880/1775] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:40:58 2022] POST /identity/v3/projects => generated 359 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:58.218513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5247ed-22e7-4e44-a9bd-77e6b2187910 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.243502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5247ed-22e7-4e44-a9bd-77e6b2187910 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.433846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c4cad-daa5-4c84-b498-9b2da21d3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.435461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c4cad-daa5-4c84-b498-9b2da21d3cbc admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.435868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c4cad-daa5-4c84-b498-9b2da21d3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.436261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c4cad-daa5-4c84-b498-9b2da21d3cbc admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.437284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c4cad-daa5-4c84-b498-9b2da21d3cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.440216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c4cad-daa5-4c84-b498-9b2da21d3cbc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.458447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8fd4-15f4-4ae9-9106-11dd55ae8ac8 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.460801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8fd4-15f4-4ae9-9106-11dd55ae8ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.462228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f8fd4-15f4-4ae9-9106-11dd55ae8ac8 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.467979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 881/1776] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:40:58 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:40:58.509725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 896/1777] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:40:58 2022] POST /identity/v3/users => generated 280 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:40:58.509824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8fd4-15f4-4ae9-9106-11dd55ae8ac8 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.524238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f8fd4-15f4-4ae9-9106-11dd55ae8ac8 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.534206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084be81-2e27-4fa7-9099-5d7fb3c10e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.534924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084be81-2e27-4fa7-9099-5d7fb3c10e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.535732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084be81-2e27-4fa7-9099-5d7fb3c10e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.536081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084be81-2e27-4fa7-9099-5d7fb3c10e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.537624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a9a8-06b7-48fb-ae7e-036ca89bb8f2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.537915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084be81-2e27-4fa7-9099-5d7fb3c10e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.538149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a9a8-06b7-48fb-ae7e-036ca89bb8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.538585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a9a8-06b7-48fb-ae7e-036ca89bb8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.540614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084be81-2e27-4fa7-9099-5d7fb3c10e88 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.579979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 882/1778] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:58.581405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084be81-2e27-4fa7-9099-5d7fb3c10e88 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.597283 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084be81-2e27-4fa7-9099-5d7fb3c10e88 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.608757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a87f7-a2f1-42df-ab08-9bc3860b5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.611484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a87f7-a2f1-42df-ab08-9bc3860b5f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.611988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a87f7-a2f1-42df-ab08-9bc3860b5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.612301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a87f7-a2f1-42df-ab08-9bc3860b5f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.613290 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a87f7-a2f1-42df-ab08-9bc3860b5f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.616136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a87f7-a2f1-42df-ab08-9bc3860b5f9f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.632424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f7e8a9a8-06b7-48fb-ae7e-036ca89bb8f2 None None] MFA Rules not processed for user `8d086e815c1542d1ba9daf81e644166a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:58.639718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f7e8a9a8-06b7-48fb-ae7e-036ca89bb8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:58.647379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 883/1779] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:40:58.650221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a87f7-a2f1-42df-ab08-9bc3860b5f9f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:58.676721 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a87f7-a2f1-42df-ab08-9bc3860b5f9f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:58.684205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73887a64-d919-44fd-a244-8778c7726523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:58.684898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73887a64-d919-44fd-a244-8778c7726523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.685177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73887a64-d919-44fd-a244-8778c7726523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.685451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73887a64-d919-44fd-a244-8778c7726523 admin admin] PATH_INFO: `/v3/projects/8eda2af3b6d441bf83721ffe9b9125d3/users/6d3bc102b78040ec93910fb67e343334/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.725732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:58.736521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73887a64-d919-44fd-a244-8778c7726523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eda2af3b6d441bf83721ffe9b9125d3, user_id=6d3bc102b78040ec93910fb67e343334, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:58.743264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73887a64-d919-44fd-a244-8778c7726523 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:58.796256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 884/1780] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:40:58 2022] PUT /identity/v3/projects/8eda2af3b6d441bf83721ffe9b9125d3/users/6d3bc102b78040ec93910fb67e343334/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:58.809973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb592f-cbba-4e18-8d0c-2eb684bf228f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.810315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb592f-cbba-4e18-8d0c-2eb684bf228f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.812338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb592f-cbba-4e18-8d0c-2eb684bf228f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.843251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 897/1781] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:58.883145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-20bb592f-cbba-4e18-8d0c-2eb684bf228f None None] MFA Rules not processed for user `6d3bc102b78040ec93910fb67e343334`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:58.884517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-20bb592f-cbba-4e18-8d0c-2eb684bf228f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:58.884641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d35af3-e00f-4cc0-9b57-b87a24740742 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.884939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d35af3-e00f-4cc0-9b57-b87a24740742 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.885213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d35af3-e00f-4cc0-9b57-b87a24740742 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.887035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 898/1782] 10.222.0.89 () {54 vars in 961 bytes} [Fri Aug 26 15:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:40:58.898655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae53fd3-fcfb-45cf-8f0c-a53f71768215 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:58.898984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae53fd3-fcfb-45cf-8f0c-a53f71768215 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:58.899266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae53fd3-fcfb-45cf-8f0c-a53f71768215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:58.956850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cae53fd3-fcfb-45cf-8f0c-a53f71768215 None None] MFA Rules not processed for user `8d086e815c1542d1ba9daf81e644166a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:58.958119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cae53fd3-fcfb-45cf-8f0c-a53f71768215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.112806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 899/1783] 10.222.0.89 () {58 vars in 1058 bytes} [Fri Aug 26 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:40:59.127620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae53fd3-fcfb-45cf-8f0c-a53f71768215 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.139690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 885/1784] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:59.191646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae53fd3-fcfb-45cf-8f0c-a53f71768215 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.194359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb592f-cbba-4e18-8d0c-2eb684bf228f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.196947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-20bb592f-cbba-4e18-8d0c-2eb684bf228f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.206458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19df585-b76a-4b84-92b9-2535d0ef8bf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:59.209113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19df585-b76a-4b84-92b9-2535d0ef8bf6 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.209567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19df585-b76a-4b84-92b9-2535d0ef8bf6 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.212013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19df585-b76a-4b84-92b9-2535d0ef8bf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.228962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19df585-b76a-4b84-92b9-2535d0ef8bf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.242201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19df585-b76a-4b84-92b9-2535d0ef8bf6 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.259001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 900/1785] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:59.353734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:59.406501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb592f-cbba-4e18-8d0c-2eb684bf228f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.410785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b1d01-2f82-47c6-b58d-4129f6573669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:59.411936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b1d01-2f82-47c6-b58d-4129f6573669 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.412270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b1d01-2f82-47c6-b58d-4129f6573669 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.412551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b1d01-2f82-47c6-b58d-4129f6573669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.427580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b1d01-2f82-47c6-b58d-4129f6573669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.429771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b1d01-2f82-47c6-b58d-4129f6573669 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.449336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 886/1786] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:40:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:40:59.466691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19df585-b76a-4b84-92b9-2535d0ef8bf6 service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:40:59.510090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd5cd9-8d1b-4c74-a37f-587911b3482d None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.510548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd5cd9-8d1b-4c74-a37f-587911b3482d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.510829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd5cd9-8d1b-4c74-a37f-587911b3482d None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.513262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 887/1787] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:40:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:40:59.609176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607a334-88ee-4e5a-acf7-f447d4e3159f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.609918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607a334-88ee-4e5a-acf7-f447d4e3159f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.610296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607a334-88ee-4e5a-acf7-f447d4e3159f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.648613 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7607a334-88ee-4e5a-acf7-f447d4e3159f None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:59.651781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7607a334-88ee-4e5a-acf7-f447d4e3159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:40:59.656332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19df585-b76a-4b84-92b9-2535d0ef8bf6 service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:40:59.670523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:40:59.672949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.675499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.676450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] PATH_INFO: `/v3/users/6d3bc102b78040ec93910fb67e343334` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.679780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3bc102b78040ec93910fb67e343334)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:40:59.688703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:40:59.823885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3bc102b78040ec93910fb67e343334'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.845102 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:40:59.876779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3bc102b78040ec93910fb67e343334'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.877906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3bc102b78040ec93910fb67e343334'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.881284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 888/1788] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:40:59.898527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3bc102b78040ec93910fb67e343334'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.899354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3bc102b78040ec93910fb67e343334'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:40:59.928227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 901/1789] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:40:59 2022] DELETE /identity/v3/users/6d3bc102b78040ec93910fb67e343334 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:40:59.930565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a1ae-00c2-4351-9617-1b0fe19041ca None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:40:59.930862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a1ae-00c2-4351-9617-1b0fe19041ca None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:40:59.931171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a1ae-00c2-4351-9617-1b0fe19041ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:40:59.988048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8946a1ae-00c2-4351-9617-1b0fe19041ca None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:40:59.990238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8946a1ae-00c2-4351-9617-1b0fe19041ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.029093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.030598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.103982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 889/1790] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:00.196509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28800a4-1960-4c5c-9c0b-ff8b118a7ce7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.209014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.209232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a1ae-00c2-4351-9617-1b0fe19041ca None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:00.209705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.210170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.212289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8946a1ae-00c2-4351-9617-1b0fe19041ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.212425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.214751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:00.232417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.234611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.250170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 902/1791] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:00.356635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a1ae-00c2-4351-9617-1b0fe19041ca None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:00.369021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8ecc1-243d-47e4-bdc4-42ca2cc74622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:00.370244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8ecc1-243d-47e4-bdc4-42ca2cc74622 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:00.371615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8ecc1-243d-47e4-bdc4-42ca2cc74622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:00.371907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8ecc1-243d-47e4-bdc4-42ca2cc74622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:00.385091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8ecc1-243d-47e4-bdc4-42ca2cc74622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:00.386526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8ecc1-243d-47e4-bdc4-42ca2cc74622 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:00.406270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 890/1792] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:41:01.761394 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:01.763302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.794403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613c503-4d66-408a-98ea-9ccc17735b0e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.797634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613c503-4d66-408a-98ea-9ccc17735b0e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.798197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613c503-4d66-408a-98ea-9ccc17735b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.820638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f7a1f-ebc7-440c-b90a-0ad3c5cbd60d service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:01.841074 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:01.841813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:01.842162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:01.842511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] PATH_INFO: `/v3/users/794b4a8edbbf431abbd20bab461e802f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:01.844340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794b4a8edbbf431abbd20bab461e802f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:01.846708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:01.859817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1613c503-4d66-408a-98ea-9ccc17735b0e None None] MFA Rules not processed for user `91137d4fc46f401aa969752a5adf176f`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:01.861386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1613c503-4d66-408a-98ea-9ccc17735b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:01.878795 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:01.945959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794b4a8edbbf431abbd20bab461e802f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.012312 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 891/1793] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:02.021755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794b4a8edbbf431abbd20bab461e802f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.023793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794b4a8edbbf431abbd20bab461e802f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.053486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794b4a8edbbf431abbd20bab461e802f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.054774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-29ef5997-fa57-4c48-8636-5059816d6a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794b4a8edbbf431abbd20bab461e802f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:02.089402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 903/1794] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:01 2022] DELETE /identity/v3/users/794b4a8edbbf431abbd20bab461e802f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:02.711164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613c503-4d66-408a-98ea-9ccc17735b0e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:02.712955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1613c503-4d66-408a-98ea-9ccc17735b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:02.729472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613c503-4d66-408a-98ea-9ccc17735b0e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:02.910759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:02.912839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:02.913532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:02.914093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] PATH_INFO: `/v3/projects/8eda2af3b6d441bf83721ffe9b9125d3` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:02.917377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eda2af3b6d441bf83721ffe9b9125d3)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:02.921640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.011485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eda2af3b6d441bf83721ffe9b9125d3', 'request_id': 'req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.025309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eda2af3b6d441bf83721ffe9b9125d3', 'request_id': 'req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.035299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eda2af3b6d441bf83721ffe9b9125d3', 'request_id': 'req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.056861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] The token cache is being invalidate because project 8eda2af3b6d441bf83721ffe9b9125d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:03.057371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.058573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6998fd5c-cacb-47d7-9b5c-3b740b9f89f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:03.060736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 892/1795] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:02 2022] DELETE /identity/v3/projects/8eda2af3b6d441bf83721ffe9b9125d3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:03.070886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bdfda-b75c-46d4-9b02-c74e8671f489 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.071353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bdfda-b75c-46d4-9b02-c74e8671f489 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.071353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bdfda-b75c-46d4-9b02-c74e8671f489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.106211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-870bdfda-b75c-46d4-9b02-c74e8671f489 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:03.107589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-870bdfda-b75c-46d4-9b02-c74e8671f489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.154640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:03.203606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fee1d8-4900-4953-972e-54cbcb382696 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.204232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fee1d8-4900-4953-972e-54cbcb382696 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.204716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fee1d8-4900-4953-972e-54cbcb382696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.240640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 904/1796] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:03.249209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af932022-0858-42dc-b1af-97fa9aa65b87 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.249634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af932022-0858-42dc-b1af-97fa9aa65b87 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.250087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af932022-0858-42dc-b1af-97fa9aa65b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.281501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-23fee1d8-4900-4953-972e-54cbcb382696 None None] MFA Rules not processed for user `af9ccd20d4224d7f8e61f02e19a053bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:03.283043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-23fee1d8-4900-4953-972e-54cbcb382696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.296076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-af932022-0858-42dc-b1af-97fa9aa65b87 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:03.297311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-af932022-0858-42dc-b1af-97fa9aa65b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.312454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 905/1797] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:03.313551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af932022-0858-42dc-b1af-97fa9aa65b87 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.326391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af932022-0858-42dc-b1af-97fa9aa65b87 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.333543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fa45-8fb8-409e-a534-4499fd881b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.334333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fa45-8fb8-409e-a534-4499fd881b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.334729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fa45-8fb8-409e-a534-4499fd881b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.335150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fa45-8fb8-409e-a534-4499fd881b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.335990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333fa45-8fb8-409e-a534-4499fd881b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:03.336564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333fa45-8fb8-409e-a534-4499fd881b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.339158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333fa45-8fb8-409e-a534-4499fd881b18 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.359499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 906/1798] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:03.360716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fa45-8fb8-409e-a534-4499fd881b18 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.369339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:03.382986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fa45-8fb8-409e-a534-4499fd881b18 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.404753 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd818a-0d74-405f-8ab5-3e610e2b6fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.405588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd818a-0d74-405f-8ab5-3e610e2b6fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.406016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd818a-0d74-405f-8ab5-3e610e2b6fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.406457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd818a-0d74-405f-8ab5-3e610e2b6fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.407364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd818a-0d74-405f-8ab5-3e610e2b6fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.409433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd818a-0d74-405f-8ab5-3e610e2b6fb9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.576987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 893/1799] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:03.576987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fee1d8-4900-4953-972e-54cbcb382696 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.576987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-23fee1d8-4900-4953-972e-54cbcb382696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.577356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 907/1800] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/projects => generated 365 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:03.584395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28a28e-841f-4db0-98d3-0ee35439a1c9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.584690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28a28e-841f-4db0-98d3-0ee35439a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.585039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28a28e-841f-4db0-98d3-0ee35439a1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.639730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fee1d8-4900-4953-972e-54cbcb382696 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.668004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cf28a28e-841f-4db0-98d3-0ee35439a1c9 None None] MFA Rules not processed for user `1cee8d97229f421899c131dc675609fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:03.669195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cf28a28e-841f-4db0-98d3-0ee35439a1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:03.870701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.871067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 908/1801] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:03.871945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.872075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28a28e-841f-4db0-98d3-0ee35439a1c9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.872473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.872870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] PATH_INFO: `/v3/projects/88e44c5565624c26b1478678454c51ba` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.875896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e44c5565624c26b1478678454c51ba)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.881206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.900281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28a28e-841f-4db0-98d3-0ee35439a1c9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:03.911310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153a3cb-24ac-4074-bbbe-40ff610d53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:03.911942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153a3cb-24ac-4074-bbbe-40ff610d53ee admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:03.912412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153a3cb-24ac-4074-bbbe-40ff610d53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:03.912700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153a3cb-24ac-4074-bbbe-40ff610d53ee admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:03.913358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153a3cb-24ac-4074-bbbe-40ff610d53ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:03.921809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153a3cb-24ac-4074-bbbe-40ff610d53ee admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:03.961236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 909/1802] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:03 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:03.962617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153a3cb-24ac-4074-bbbe-40ff610d53ee admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:03.991089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153a3cb-24ac-4074-bbbe-40ff610d53ee admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.017793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e44c5565624c26b1478678454c51ba', 'request_id': 'req-2d09f6ee-3879-4601-a06f-06b48fa5486b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.037980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e44c5565624c26b1478678454c51ba', 'request_id': 'req-2d09f6ee-3879-4601-a06f-06b48fa5486b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.076195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e44c5565624c26b1478678454c51ba', 'request_id': 'req-2d09f6ee-3879-4601-a06f-06b48fa5486b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.114993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] The token cache is being invalidate because project 88e44c5565624c26b1478678454c51ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:04.114993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.116196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.121618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 894/1803] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:03 2022] DELETE /identity/v3/projects/88e44c5565624c26b1478678454c51ba => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:04.122623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.124444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.192419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f14a9-cb7c-4d94-9b7f-06f60f3b4b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.193133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f14a9-cb7c-4d94-9b7f-06f60f3b4b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.195033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f14a9-cb7c-4d94-9b7f-06f60f3b4b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.195364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f14a9-cb7c-4d94-9b7f-06f60f3b4b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.196072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f14a9-cb7c-4d94-9b7f-06f60f3b4b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.201340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f14a9-cb7c-4d94-9b7f-06f60f3b4b58 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.220736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09f6ee-3879-4601-a06f-06b48fa5486b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.229498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 910/1804] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:04.229977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.230966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.231479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.231869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] PATH_INFO: `/v3/users/3b4a84b27ce241a6985bb1e26001c74d` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.234556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f14a9-cb7c-4d94-9b7f-06f60f3b4b58 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.235344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4a84b27ce241a6985bb1e26001c74d)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.237373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d84f14a9-cb7c-4d94-9b7f-06f60f3b4b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.239771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.243164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:04.263849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f14a9-cb7c-4d94-9b7f-06f60f3b4b58 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.284062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e1240-35f6-43b9-93e4-0ea92b4ddca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.284945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e1240-35f6-43b9-93e4-0ea92b4ddca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.289140 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e1240-35f6-43b9-93e4-0ea92b4ddca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.289596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e1240-35f6-43b9-93e4-0ea92b4ddca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.291283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e1240-35f6-43b9-93e4-0ea92b4ddca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.294465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e1240-35f6-43b9-93e4-0ea92b4ddca4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.303475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:04.340911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 911/1805] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:04.345860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e1240-35f6-43b9-93e4-0ea92b4ddca4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.354327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4a84b27ce241a6985bb1e26001c74d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.355830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4a84b27ce241a6985bb1e26001c74d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.372349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e1240-35f6-43b9-93e4-0ea92b4ddca4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.390594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb6558-b27c-423f-86a5-0542c329b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.391333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb6558-b27c-423f-86a5-0542c329b9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.391838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb6558-b27c-423f-86a5-0542c329b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.392128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb6558-b27c-423f-86a5-0542c329b9fd admin admin] PATH_INFO: `/v3/projects/b04e219af46a40d68e068d76b848d76b/users/da825ccdd5b34a22a0b74865d7215624/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.394982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4a84b27ce241a6985bb1e26001c74d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.410074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4a84b27ce241a6985bb1e26001c74d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.411130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e0fd00e9-abde-4348-a9af-b44349814997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4a84b27ce241a6985bb1e26001c74d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:04.435756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb6558-b27c-423f-86a5-0542c329b9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04e219af46a40d68e068d76b848d76b, user_id=da825ccdd5b34a22a0b74865d7215624, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.439207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb6558-b27c-423f-86a5-0542c329b9fd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.439662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 895/1806] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:04 2022] DELETE /identity/v3/users/3b4a84b27ce241a6985bb1e26001c74d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:04.479797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 912/1807] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:04 2022] PUT /identity/v3/projects/b04e219af46a40d68e068d76b848d76b/users/da825ccdd5b34a22a0b74865d7215624/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:04.483201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a329d-0a2c-4a50-8506-faada2bca0d3 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.483978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a329d-0a2c-4a50-8506-faada2bca0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.484552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a329d-0a2c-4a50-8506-faada2bca0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.558019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-eb0a329d-0a2c-4a50-8506-faada2bca0d3 None None] MFA Rules not processed for user `da825ccdd5b34a22a0b74865d7215624`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:04.559828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-eb0a329d-0a2c-4a50-8506-faada2bca0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.669811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb6558-b27c-423f-86a5-0542c329b9fd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.671365 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8ecb6558-b27c-423f-86a5-0542c329b9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.725666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 896/1808] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:04.733734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a329d-0a2c-4a50-8506-faada2bca0d3 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:04.736221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-eb0a329d-0a2c-4a50-8506-faada2bca0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.865125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb6558-b27c-423f-86a5-0542c329b9fd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.869256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a329d-0a2c-4a50-8506-faada2bca0d3 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:04.910746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bae5b-1144-4020-bb9c-32b9880e924a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.913405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bae5b-1144-4020-bb9c-32b9880e924a service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.915735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bae5b-1144-4020-bb9c-32b9880e924a service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.916444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec98d3-f31e-4a45-a601-328b2a33a27f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:04.918544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec98d3-f31e-4a45-a601-328b2a33a27f service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:04.918951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bae5b-1144-4020-bb9c-32b9880e924a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.919332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec98d3-f31e-4a45-a601-328b2a33a27f service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:04.920360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec98d3-f31e-4a45-a601-328b2a33a27f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:04.925881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-26ec98d3-f31e-4a45-a601-328b2a33a27f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:04.942705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bae5b-1144-4020-bb9c-32b9880e924a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:04.950558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bae5b-1144-4020-bb9c-32b9880e924a service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:04.980683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 897/1809] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:41:05.036851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec98d3-f31e-4a45-a601-328b2a33a27f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:05.040346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec98d3-f31e-4a45-a601-328b2a33a27f service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:05.052758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 913/1810] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:05.553080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bae5b-1144-4020-bb9c-32b9880e924a service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:05.554610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b75bae5b-1144-4020-bb9c-32b9880e924a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:05.597696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:05.729894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bae5b-1144-4020-bb9c-32b9880e924a service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:05.735805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:05.737235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:05.737694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:05.738132 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] PATH_INFO: `/v3/projects/fdc64e71788b40e88bf06b4e3dca0b70` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:05.739861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc64e71788b40e88bf06b4e3dca0b70)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:05.742447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:05.949692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc64e71788b40e88bf06b4e3dca0b70', 'request_id': 'req-db53552a-8a3e-4d0d-b537-1fe603beeb6c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.962021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc64e71788b40e88bf06b4e3dca0b70', 'request_id': 'req-db53552a-8a3e-4d0d-b537-1fe603beeb6c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.972904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc64e71788b40e88bf06b4e3dca0b70', 'request_id': 'req-db53552a-8a3e-4d0d-b537-1fe603beeb6c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.987911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] The token cache is being invalidate because project fdc64e71788b40e88bf06b4e3dca0b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:05.988208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.988897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-db53552a-8a3e-4d0d-b537-1fe603beeb6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:05.990969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 898/1811] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:05 2022] DELETE /identity/v3/projects/fdc64e71788b40e88bf06b4e3dca0b70 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:05.996640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f572583-f488-4fbb-a3c9-e43e618c9a67 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:05.997186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f572583-f488-4fbb-a3c9-e43e618c9a67 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:05.997186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f572583-f488-4fbb-a3c9-e43e618c9a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.020133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2f572583-f488-4fbb-a3c9-e43e618c9a67 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:06.022156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2f572583-f488-4fbb-a3c9-e43e618c9a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.112794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 914/1812] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:06.124713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4a4d-6544-4afb-a1e7-3ee5e3199ec4 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.125076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4a4d-6544-4afb-a1e7-3ee5e3199ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.125411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f4a4d-6544-4afb-a1e7-3ee5e3199ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.150345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-755f4a4d-6544-4afb-a1e7-3ee5e3199ec4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:06.151626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-755f4a4d-6544-4afb-a1e7-3ee5e3199ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.161257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 899/1813] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:06.166033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f572583-f488-4fbb-a3c9-e43e618c9a67 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.177806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f572583-f488-4fbb-a3c9-e43e618c9a67 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.187094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2ba56-0952-4265-a484-1de7b5bcebc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.187751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ba56-0952-4265-a484-1de7b5bcebc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.188032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ba56-0952-4265-a484-1de7b5bcebc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.188351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ba56-0952-4265-a484-1de7b5bcebc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.189109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2ba56-0952-4265-a484-1de7b5bcebc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:06.189507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2ba56-0952-4265-a484-1de7b5bcebc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.205152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2ba56-0952-4265-a484-1de7b5bcebc8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.216859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:06.231057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f4a4d-6544-4afb-a1e7-3ee5e3199ec4 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.231264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 915/1814] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:06.243199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f4a4d-6544-4afb-a1e7-3ee5e3199ec4 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.249498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb7c82-e395-4d80-bea1-740f281ca97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.250318 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb7c82-e395-4d80-bea1-740f281ca97a admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.250604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb7c82-e395-4d80-bea1-740f281ca97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.250879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb7c82-e395-4d80-bea1-740f281ca97a admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.251623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb7c82-e395-4d80-bea1-740f281ca97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.266670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb7c82-e395-4d80-bea1-740f281ca97a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.348052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 900/1815] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:06 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:06.349271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2ba56-0952-4265-a484-1de7b5bcebc8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.383332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2ba56-0952-4265-a484-1de7b5bcebc8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.393308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc0a4c-82e4-400e-a4f8-df022daa4280 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.393521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc0a4c-82e4-400e-a4f8-df022daa4280 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.393789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc0a4c-82e4-400e-a4f8-df022daa4280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.454427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1fdc0a4c-82e4-400e-a4f8-df022daa4280 None None] MFA Rules not processed for user `e56d4b78d51b4a81842f5724aaff7f85`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:06.458144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1fdc0a4c-82e4-400e-a4f8-df022daa4280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:06.577918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd46763-e444-45a3-a4bc-48b5fa0613bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.578702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd46763-e444-45a3-a4bc-48b5fa0613bb admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.579319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd46763-e444-45a3-a4bc-48b5fa0613bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.580729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd46763-e444-45a3-a4bc-48b5fa0613bb admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.581909 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd46763-e444-45a3-a4bc-48b5fa0613bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.585778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd46763-e444-45a3-a4bc-48b5fa0613bb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.633497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 901/1816] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:06.642181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc0a4c-82e4-400e-a4f8-df022daa4280 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.651649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 916/1817] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:06 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:06.666198 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc0a4c-82e4-400e-a4f8-df022daa4280 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.679194 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adf746-ff96-4ea3-8af5-c1bb9852d4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.680211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adf746-ff96-4ea3-8af5-c1bb9852d4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.680875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adf746-ff96-4ea3-8af5-c1bb9852d4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.681362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adf746-ff96-4ea3-8af5-c1bb9852d4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.682563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adf746-ff96-4ea3-8af5-c1bb9852d4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.686597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adf746-ff96-4ea3-8af5-c1bb9852d4f1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.711476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd46763-e444-45a3-a4bc-48b5fa0613bb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.711648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 902/1818] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:06.730928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd46763-e444-45a3-a4bc-48b5fa0613bb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.736581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32edd5-0550-4303-b158-852a416471db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.737211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32edd5-0550-4303-b158-852a416471db admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.737490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32edd5-0550-4303-b158-852a416471db admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.737762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32edd5-0550-4303-b158-852a416471db admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.738424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32edd5-0550-4303-b158-852a416471db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.740641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32edd5-0550-4303-b158-852a416471db admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.756964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 917/1819] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:06.761624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adf746-ff96-4ea3-8af5-c1bb9852d4f1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:06.779100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adf746-ff96-4ea3-8af5-c1bb9852d4f1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:06.786707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a61f98-44aa-4048-9dfc-2ca418977c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:06.787472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a61f98-44aa-4048-9dfc-2ca418977c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.787758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a61f98-44aa-4048-9dfc-2ca418977c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.788037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a61f98-44aa-4048-9dfc-2ca418977c37 admin admin] PATH_INFO: `/v3/projects/8aa7b12a2571487f96e2967629685c48/users/a1a2017d2b3f4fbd8aed65128f1f163b/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.792435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:06.821604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a61f98-44aa-4048-9dfc-2ca418977c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa7b12a2571487f96e2967629685c48, user_id=a1a2017d2b3f4fbd8aed65128f1f163b, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:06.826032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a61f98-44aa-4048-9dfc-2ca418977c37 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:06.871948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 903/1820] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:06 2022] PUT /identity/v3/projects/8aa7b12a2571487f96e2967629685c48/users/a1a2017d2b3f4fbd8aed65128f1f163b/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:06.872144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbc69d-e0b7-44f8-96a6-7c5564b5ab62 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:06.872568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbc69d-e0b7-44f8-96a6-7c5564b5ab62 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:06.872851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbc69d-e0b7-44f8-96a6-7c5564b5ab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:06.931413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-adbbc69d-e0b7-44f8-96a6-7c5564b5ab62 None None] MFA Rules not processed for user `a1a2017d2b3f4fbd8aed65128f1f163b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:06.933448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-adbbc69d-e0b7-44f8-96a6-7c5564b5ab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:07.269827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 918/1821] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:07.274739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a61f98-44aa-4048-9dfc-2ca418977c37 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.431303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a61f98-44aa-4048-9dfc-2ca418977c37 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.458792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7c47a-93c8-4f1c-ad40-35e0a4d756c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.462250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7c47a-93c8-4f1c-ad40-35e0a4d756c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.478709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7c47a-93c8-4f1c-ad40-35e0a4d756c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.481530 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7c47a-93c8-4f1c-ad40-35e0a4d756c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.482252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7c47a-93c8-4f1c-ad40-35e0a4d756c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.493324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7c47a-93c8-4f1c-ad40-35e0a4d756c0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.539433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 904/1822] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:07 2022] POST /identity/v3/projects => generated 365 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:07.544208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbc69d-e0b7-44f8-96a6-7c5564b5ab62 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.572401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbc69d-e0b7-44f8-96a6-7c5564b5ab62 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.712225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dcdbc-60d3-4255-bc07-480beae07b93 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.712970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dcdbc-60d3-4255-bc07-480beae07b93 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.713259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dcdbc-60d3-4255-bc07-480beae07b93 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.715862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 905/1823] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:41:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:41:07.802981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014db51-8313-406c-9c9c-f942fd646923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.802981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014db51-8313-406c-9c9c-f942fd646923 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.802981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014db51-8313-406c-9c9c-f942fd646923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.802981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014db51-8313-406c-9c9c-f942fd646923 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.803930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014db51-8313-406c-9c9c-f942fd646923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.805639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014db51-8313-406c-9c9c-f942fd646923 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.831669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:07.843781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c910545-1345-44ac-b3da-a40562d7fcc1 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.844942 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c910545-1345-44ac-b3da-a40562d7fcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.846092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c910545-1345-44ac-b3da-a40562d7fcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.852780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 919/1824] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:07 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:07.857275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014db51-8313-406c-9c9c-f942fd646923 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.874612 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014db51-8313-406c-9c9c-f942fd646923 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.883358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561abb-1c07-47f0-b04c-de913a4f9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.884458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561abb-1c07-47f0-b04c-de913a4f9602 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.884847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561abb-1c07-47f0-b04c-de913a4f9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.886121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561abb-1c07-47f0-b04c-de913a4f9602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.887137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28561abb-1c07-47f0-b04c-de913a4f9602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.889203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28561abb-1c07-47f0-b04c-de913a4f9602 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:07.890716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-9c910545-1345-44ac-b3da-a40562d7fcc1 None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:07.893176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9c910545-1345-44ac-b3da-a40562d7fcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:07.913337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 920/1825] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:07.917763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561abb-1c07-47f0-b04c-de913a4f9602 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:07.938204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561abb-1c07-47f0-b04c-de913a4f9602 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:07.955355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733f9ab-3765-4c14-a426-add495ecc79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:07.956541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733f9ab-3765-4c14-a426-add495ecc79b admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:07.957061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733f9ab-3765-4c14-a426-add495ecc79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:07.957483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733f9ab-3765-4c14-a426-add495ecc79b admin admin] PATH_INFO: `/v3/projects/28298d8bcd2f45aa9199d2f7fc5c866c/users/5e13edaa691b41349728b1fe6f6f0931/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:07.985907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733f9ab-3765-4c14-a426-add495ecc79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28298d8bcd2f45aa9199d2f7fc5c866c, user_id=5e13edaa691b41349728b1fe6f6f0931, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:07.991218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733f9ab-3765-4c14-a426-add495ecc79b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.017414 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 921/1826] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:07 2022] PUT /identity/v3/projects/28298d8bcd2f45aa9199d2f7fc5c866c/users/5e13edaa691b41349728b1fe6f6f0931/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:08.022777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733f9ab-3765-4c14-a426-add495ecc79b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.056424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 906/1827] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:08.142706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733f9ab-3765-4c14-a426-add495ecc79b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.155121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d09fdb-ceb3-4167-8721-191b1b8de197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.155790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09fdb-ceb3-4167-8721-191b1b8de197 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.156079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09fdb-ceb3-4167-8721-191b1b8de197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.156352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d09fdb-ceb3-4167-8721-191b1b8de197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.159329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d09fdb-ceb3-4167-8721-191b1b8de197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.162426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d09fdb-ceb3-4167-8721-191b1b8de197 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.195277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 922/1828] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:08.200889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c910545-1345-44ac-b3da-a40562d7fcc1 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.239655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c910545-1345-44ac-b3da-a40562d7fcc1 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.267472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398deec3-bf5e-461c-aa0a-55e413951fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.268295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398deec3-bf5e-461c-aa0a-55e413951fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.268582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398deec3-bf5e-461c-aa0a-55e413951fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.268861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398deec3-bf5e-461c-aa0a-55e413951fe5 admin admin] PATH_INFO: `/v3/projects/28298d8bcd2f45aa9199d2f7fc5c866c/users/5e13edaa691b41349728b1fe6f6f0931/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.277207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398deec3-bf5e-461c-aa0a-55e413951fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28298d8bcd2f45aa9199d2f7fc5c866c, user_id=5e13edaa691b41349728b1fe6f6f0931, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.282773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398deec3-bf5e-461c-aa0a-55e413951fe5 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.327329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 907/1829] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:08 2022] PUT /identity/v3/projects/28298d8bcd2f45aa9199d2f7fc5c866c/users/5e13edaa691b41349728b1fe6f6f0931/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:08.330965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f0d06-349a-4188-bee5-db355002695c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.330965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f0d06-349a-4188-bee5-db355002695c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.330965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f0d06-349a-4188-bee5-db355002695c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.414276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-232f0d06-349a-4188-bee5-db355002695c None None] MFA Rules not processed for user `5e13edaa691b41349728b1fe6f6f0931`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:08.419030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-232f0d06-349a-4188-bee5-db355002695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:08.547848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 923/1830] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:08.560624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398deec3-bf5e-461c-aa0a-55e413951fe5 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.563033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-398deec3-bf5e-461c-aa0a-55e413951fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:08.693196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:08.704261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398deec3-bf5e-461c-aa0a-55e413951fe5 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.712409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100270f-d4d2-4692-8675-3241c1eb0bbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.714611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100270f-d4d2-4692-8675-3241c1eb0bbf service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.715030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100270f-d4d2-4692-8675-3241c1eb0bbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.715492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100270f-d4d2-4692-8675-3241c1eb0bbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.733145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100270f-d4d2-4692-8675-3241c1eb0bbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:08.736109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100270f-d4d2-4692-8675-3241c1eb0bbf service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:08.756829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 908/1831] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:41:08.911724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f0d06-349a-4188-bee5-db355002695c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:08.923580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f0d06-349a-4188-bee5-db355002695c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:08.928876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fb9f8-934d-47dd-83c3-41f8c7c41a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:08.929518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fb9f8-934d-47dd-83c3-41f8c7c41a59 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:08.929817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fb9f8-934d-47dd-83c3-41f8c7c41a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:08.930069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fb9f8-934d-47dd-83c3-41f8c7c41a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:08.987220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:09.011227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100270f-d4d2-4692-8675-3241c1eb0bbf service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:09.013172 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d100270f-d4d2-4692-8675-3241c1eb0bbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:09.015991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fb9f8-934d-47dd-83c3-41f8c7c41a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.017522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fb9f8-934d-47dd-83c3-41f8c7c41a59 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.030109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 924/1832] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:09.159141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100270f-d4d2-4692-8675-3241c1eb0bbf service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:09.167921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e9c02-5829-4c4b-9caf-d9303e3b2beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:09.171500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9c02-5829-4c4b-9caf-d9303e3b2beb service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:09.172065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9c02-5829-4c4b-9caf-d9303e3b2beb service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:09.172369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9c02-5829-4c4b-9caf-d9303e3b2beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:09.190421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e9c02-5829-4c4b-9caf-d9303e3b2beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:09.192336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e9c02-5829-4c4b-9caf-d9303e3b2beb service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:09.206523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 909/1833] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:41:11.256774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd1aa6-b449-4567-abac-df9ea374da17 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.262246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd1aa6-b449-4567-abac-df9ea374da17 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.262967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd1aa6-b449-4567-abac-df9ea374da17 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.268622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 925/1834] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:41:11 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:41:11.282795 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cafca8-9124-42b7-955a-d51290163f4b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.283412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cafca8-9124-42b7-955a-d51290163f4b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.284261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cafca8-9124-42b7-955a-d51290163f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.331488 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-40cafca8-9124-42b7-955a-d51290163f4b None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:11.332751 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-40cafca8-9124-42b7-955a-d51290163f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:11.356603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 910/1835] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:41:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:11.808429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd1aa6-b449-4567-abac-df9ea374da17 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:11.836289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd1aa6-b449-4567-abac-df9ea374da17 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:11.856525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15d517-67a7-4d71-921b-2e142a832c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:11.857299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d517-67a7-4d71-921b-2e142a832c7c service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:11.857651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d517-67a7-4d71-921b-2e142a832c7c service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:11.858795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d517-67a7-4d71-921b-2e142a832c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:11.887473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15d517-67a7-4d71-921b-2e142a832c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:11.890368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15d517-67a7-4d71-921b-2e142a832c7c service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:11.912591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 926/1836] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:12.608404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cafca8-9124-42b7-955a-d51290163f4b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:12.698824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cafca8-9124-42b7-955a-d51290163f4b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:12.705165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:12.705825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:12.706259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:12.706681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] PATH_INFO: `/v3/users/a1a2017d2b3f4fbd8aed65128f1f163b` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:12.708165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a2017d2b3f4fbd8aed65128f1f163b)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:12.711051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:12.808242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a2017d2b3f4fbd8aed65128f1f163b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.809448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a2017d2b3f4fbd8aed65128f1f163b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.825570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a2017d2b3f4fbd8aed65128f1f163b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.837847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a2017d2b3f4fbd8aed65128f1f163b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.840649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a2017d2b3f4fbd8aed65128f1f163b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:12.843343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:12.873571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 911/1837] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:12 2022] DELETE /identity/v3/users/a1a2017d2b3f4fbd8aed65128f1f163b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:12.874426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbea91-4147-42cc-b3f6-6d708a91de12 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:12.874982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbea91-4147-42cc-b3f6-6d708a91de12 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:12.875068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbea91-4147-42cc-b3f6-6d708a91de12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:12.930028 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-47dbea91-4147-42cc-b3f6-6d708a91de12 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:12.931361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-47dbea91-4147-42cc-b3f6-6d708a91de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.034077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 927/1838] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:13.059552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:13.062137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:13.169691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7811f4-950f-4334-8053-5aad1ae1ee54 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:13.177749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c8cc-c95e-4131-8798-17a0e438d61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:13.178633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c8cc-c95e-4131-8798-17a0e438d61d service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:13.180965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c8cc-c95e-4131-8798-17a0e438d61d service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:13.181471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c8cc-c95e-4131-8798-17a0e438d61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:13.207238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60c8cc-c95e-4131-8798-17a0e438d61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:13.209702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60c8cc-c95e-4131-8798-17a0e438d61d service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:13.229436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 912/1839] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:14.969068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbea91-4147-42cc-b3f6-6d708a91de12 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:14.970812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-47dbea91-4147-42cc-b3f6-6d708a91de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:14.996601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbea91-4147-42cc-b3f6-6d708a91de12 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.006233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.007930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.008457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.008938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] PATH_INFO: `/v3/projects/8aa7b12a2571487f96e2967629685c48` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.010994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa7b12a2571487f96e2967629685c48)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.020699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.148275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa7b12a2571487f96e2967629685c48', 'request_id': 'req-0056c7be-a4d9-4901-a3ac-d868eb18ea01'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.173316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa7b12a2571487f96e2967629685c48', 'request_id': 'req-0056c7be-a4d9-4901-a3ac-d868eb18ea01'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.187335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa7b12a2571487f96e2967629685c48', 'request_id': 'req-0056c7be-a4d9-4901-a3ac-d868eb18ea01'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.205795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] The token cache is being invalidate because project 8aa7b12a2571487f96e2967629685c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:15.206685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.207771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.211591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 928/1840] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:14 2022] DELETE /identity/v3/projects/8aa7b12a2571487f96e2967629685c48 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:15.218349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c8cc-c95e-4131-8798-17a0e438d61d service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:15.240179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c8cc-c95e-4131-8798-17a0e438d61d service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:15.395595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:15.396807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:15.397404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:15.398464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] PATH_INFO: `/v3/users/5e13edaa691b41349728b1fe6f6f0931` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:15.400263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e13edaa691b41349728b1fe6f6f0931)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:15.403419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:15.517930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e13edaa691b41349728b1fe6f6f0931'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.519117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e13edaa691b41349728b1fe6f6f0931'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.578819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e13edaa691b41349728b1fe6f6f0931'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.594860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e13edaa691b41349728b1fe6f6f0931'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.596145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-7ad79a7d-ecfb-4b4e-80ac-86e8d64806b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e13edaa691b41349728b1fe6f6f0931'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:15.636786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 913/1841] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:15 2022] DELETE /identity/v3/users/5e13edaa691b41349728b1fe6f6f0931 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:16.504763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:16.516134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.521743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056c7be-a4d9-4901-a3ac-d868eb18ea01 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:16.586827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:16.602971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:16.607432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.608210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.610299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] PATH_INFO: `/v3/projects/28298d8bcd2f45aa9199d2f7fc5c866c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.612770 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28298d8bcd2f45aa9199d2f7fc5c866c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:16.616778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:16.691238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28298d8bcd2f45aa9199d2f7fc5c866c', 'request_id': 'req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.700157 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28298d8bcd2f45aa9199d2f7fc5c866c', 'request_id': 'req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.714143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28298d8bcd2f45aa9199d2f7fc5c866c', 'request_id': 'req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.727052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] The token cache is being invalidate because project 28298d8bcd2f45aa9199d2f7fc5c866c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:16.727052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.727778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-50410a0f-2db7-4aa9-93b3-1f08f5f3f131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:16.729425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 929/1842] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:16 2022] DELETE /identity/v3/projects/28298d8bcd2f45aa9199d2f7fc5c866c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:16.734459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83163862-23b5-416c-8ab9-7a137865331e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.735081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83163862-23b5-416c-8ab9-7a137865331e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.735081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83163862-23b5-416c-8ab9-7a137865331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.756181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-83163862-23b5-416c-8ab9-7a137865331e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:16.757265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-83163862-23b5-416c-8ab9-7a137865331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.764353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:16.835759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 914/1843] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:16.843999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e64f4-8961-4461-a19f-1afe622403c9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.844282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e64f4-8961-4461-a19f-1afe622403c9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.844558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e64f4-8961-4461-a19f-1afe622403c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.864782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bc3e64f4-8961-4461-a19f-1afe622403c9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:16.866015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bc3e64f4-8961-4461-a19f-1afe622403c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:16.874760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 930/1844] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:16.879289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83163862-23b5-416c-8ab9-7a137865331e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:16.890299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83163862-23b5-416c-8ab9-7a137865331e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:16.895115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8cd6-c0c2-421c-8ff0-d2194e6a387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:16.895718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8cd6-c0c2-421c-8ff0-d2194e6a387f admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.896000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8cd6-c0c2-421c-8ff0-d2194e6a387f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.896277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8cd6-c0c2-421c-8ff0-d2194e6a387f admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.897210 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8cd6-c0c2-421c-8ff0-d2194e6a387f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:16.897518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8cd6-c0c2-421c-8ff0-d2194e6a387f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:16.899296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8cd6-c0c2-421c-8ff0-d2194e6a387f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:16.912579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 915/1845] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:16.918580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e64f4-8961-4461-a19f-1afe622403c9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:16.929525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e64f4-8961-4461-a19f-1afe622403c9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:16.954295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5a9f5-e826-481b-ad1d-20e2b7f4a12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:16.955284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5a9f5-e826-481b-ad1d-20e2b7f4a12e admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:16.956638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5a9f5-e826-481b-ad1d-20e2b7f4a12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:16.957119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5a9f5-e826-481b-ad1d-20e2b7f4a12e admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:16.961470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5a9f5-e826-481b-ad1d-20e2b7f4a12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:16.967188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5a9f5-e826-481b-ad1d-20e2b7f4a12e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.093446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 931/1846] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:16 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:17.098158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8cd6-c0c2-421c-8ff0-d2194e6a387f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.116898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8cd6-c0c2-421c-8ff0-d2194e6a387f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.307579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8490-7e58-4237-87c3-a5386b171cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.307579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8490-7e58-4237-87c3-a5386b171cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.307579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8490-7e58-4237-87c3-a5386b171cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.307579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c8490-7e58-4237-87c3-a5386b171cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.308697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c8490-7e58-4237-87c3-a5386b171cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.313231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c8490-7e58-4237-87c3-a5386b171cf8 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.357582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 916/1847] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:17 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:17.359163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5a9f5-e826-481b-ad1d-20e2b7f4a12e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.379331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5a9f5-e826-481b-ad1d-20e2b7f4a12e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.391711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d57ba-40d8-4ea8-b8c0-fa7ad311f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.392688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d57ba-40d8-4ea8-b8c0-fa7ad311f64d admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.392978 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d57ba-40d8-4ea8-b8c0-fa7ad311f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.393508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d57ba-40d8-4ea8-b8c0-fa7ad311f64d admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.394077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d57ba-40d8-4ea8-b8c0-fa7ad311f64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.396240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d57ba-40d8-4ea8-b8c0-fa7ad311f64d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.416220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 932/1848] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:17.423280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8490-7e58-4237-87c3-a5386b171cf8 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.441070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c8490-7e58-4237-87c3-a5386b171cf8 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.447278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10054e00-374d-4473-9026-cba00ca9c0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.448698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10054e00-374d-4473-9026-cba00ca9c0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.448982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10054e00-374d-4473-9026-cba00ca9c0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.449254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10054e00-374d-4473-9026-cba00ca9c0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.450307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10054e00-374d-4473-9026-cba00ca9c0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.452226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10054e00-374d-4473-9026-cba00ca9c0f6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.466779 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 917/1849] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:17.471793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d57ba-40d8-4ea8-b8c0-fa7ad311f64d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.489610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d57ba-40d8-4ea8-b8c0-fa7ad311f64d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.496748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7d57a-8f94-4551-a638-5caf6ecafb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.497473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7d57a-8f94-4551-a638-5caf6ecafb80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.497805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7d57a-8f94-4551-a638-5caf6ecafb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.498082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7d57a-8f94-4551-a638-5caf6ecafb80 admin admin] PATH_INFO: `/v3/projects/f9172ca666eb48d498585652c2a5d967/users/b403594a2cf44a1b9b86111bd02e4d55/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.519406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7d57a-8f94-4551-a638-5caf6ecafb80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9172ca666eb48d498585652c2a5d967, user_id=b403594a2cf44a1b9b86111bd02e4d55, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.522969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7d57a-8f94-4551-a638-5caf6ecafb80 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.540261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 933/1850] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:17 2022] PUT /identity/v3/projects/f9172ca666eb48d498585652c2a5d967/users/b403594a2cf44a1b9b86111bd02e4d55/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:17.554580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166efc-19fd-49dc-9fa6-9b3931c03eab None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.555421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166efc-19fd-49dc-9fa6-9b3931c03eab None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.555867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c166efc-19fd-49dc-9fa6-9b3931c03eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.600802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-9c166efc-19fd-49dc-9fa6-9b3931c03eab None None] MFA Rules not processed for user `b403594a2cf44a1b9b86111bd02e4d55`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:17.602097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9c166efc-19fd-49dc-9fa6-9b3931c03eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:17.723936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 918/1851] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:17.728979 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7d57a-8f94-4551-a638-5caf6ecafb80 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.871426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7d57a-8f94-4551-a638-5caf6ecafb80 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.879044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da28e-36c2-4f0e-996d-bbe5b3f7fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:17.880106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da28e-36c2-4f0e-996d-bbe5b3f7fcbc admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:17.880732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da28e-36c2-4f0e-996d-bbe5b3f7fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:17.881220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da28e-36c2-4f0e-996d-bbe5b3f7fcbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:17.883070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da28e-36c2-4f0e-996d-bbe5b3f7fcbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:17.885529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da28e-36c2-4f0e-996d-bbe5b3f7fcbc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:17.923987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 934/1852] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:17 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:17.927763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c166efc-19fd-49dc-9fa6-9b3931c03eab None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:17.939269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c166efc-19fd-49dc-9fa6-9b3931c03eab None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:17.946868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:18.030590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814053c-595a-46d7-846c-01d1b9e3f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.031503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814053c-595a-46d7-846c-01d1b9e3f8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.031790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814053c-595a-46d7-846c-01d1b9e3f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.032072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814053c-595a-46d7-846c-01d1b9e3f8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.032863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814053c-595a-46d7-846c-01d1b9e3f8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.034827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814053c-595a-46d7-846c-01d1b9e3f8a4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.061496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 919/1853] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:17 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:18.068071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da28e-36c2-4f0e-996d-bbe5b3f7fcbc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.078531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:18.085522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da28e-36c2-4f0e-996d-bbe5b3f7fcbc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.092805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629796e-93d5-46e8-ba43-c1690ffb3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.094262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629796e-93d5-46e8-ba43-c1690ffb3f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.094607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629796e-93d5-46e8-ba43-c1690ffb3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.095348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629796e-93d5-46e8-ba43-c1690ffb3f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.096248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629796e-93d5-46e8-ba43-c1690ffb3f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.099166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629796e-93d5-46e8-ba43-c1690ffb3f5b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.114326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 935/1854] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:18.120603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814053c-595a-46d7-846c-01d1b9e3f8a4 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.133619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814053c-595a-46d7-846c-01d1b9e3f8a4 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.144111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960453f4-145c-46f3-97bd-e371ffa70c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.146142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960453f4-145c-46f3-97bd-e371ffa70c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.147990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960453f4-145c-46f3-97bd-e371ffa70c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.147990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960453f4-145c-46f3-97bd-e371ffa70c69 admin admin] PATH_INFO: `/v3/projects/d18ddd826ade4263ae400f94bbc9968e/users/86ceaaa128144ba48b9d96d8a451d713/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.167351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960453f4-145c-46f3-97bd-e371ffa70c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18ddd826ade4263ae400f94bbc9968e, user_id=86ceaaa128144ba48b9d96d8a451d713, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.170438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960453f4-145c-46f3-97bd-e371ffa70c69 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.197041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 920/1855] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:18 2022] PUT /identity/v3/projects/d18ddd826ade4263ae400f94bbc9968e/users/86ceaaa128144ba48b9d96d8a451d713/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:18.203547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629796e-93d5-46e8-ba43-c1690ffb3f5b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.227450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629796e-93d5-46e8-ba43-c1690ffb3f5b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.310667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0710702-cbef-4272-aa9c-3c4c1002e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.310667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0710702-cbef-4272-aa9c-3c4c1002e79a admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.310667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0710702-cbef-4272-aa9c-3c4c1002e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.310667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0710702-cbef-4272-aa9c-3c4c1002e79a admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.314078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0710702-cbef-4272-aa9c-3c4c1002e79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.314078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0710702-cbef-4272-aa9c-3c4c1002e79a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.325026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 936/1856] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:18.329748 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960453f4-145c-46f3-97bd-e371ffa70c69 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.341947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960453f4-145c-46f3-97bd-e371ffa70c69 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.347391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85e9bf-ca30-4145-b695-b2f7a81087b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.348083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85e9bf-ca30-4145-b695-b2f7a81087b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.348367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85e9bf-ca30-4145-b695-b2f7a81087b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.348643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85e9bf-ca30-4145-b695-b2f7a81087b6 admin admin] PATH_INFO: `/v3/projects/d18ddd826ade4263ae400f94bbc9968e/users/86ceaaa128144ba48b9d96d8a451d713/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.350652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85e9bf-ca30-4145-b695-b2f7a81087b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18ddd826ade4263ae400f94bbc9968e, user_id=86ceaaa128144ba48b9d96d8a451d713, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.353357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85e9bf-ca30-4145-b695-b2f7a81087b6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.364872 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 921/1857] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:18 2022] PUT /identity/v3/projects/d18ddd826ade4263ae400f94bbc9968e/users/86ceaaa128144ba48b9d96d8a451d713/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:18.376465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8d67f-b506-43cd-9231-04b7b4be54f2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.376881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8d67f-b506-43cd-9231-04b7b4be54f2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.377034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8d67f-b506-43cd-9231-04b7b4be54f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.407910 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d1f8d67f-b506-43cd-9231-04b7b4be54f2 None None] MFA Rules not processed for user `86ceaaa128144ba48b9d96d8a451d713`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:18.409158 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d1f8d67f-b506-43cd-9231-04b7b4be54f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.553018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 937/1858] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:18.567112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85e9bf-ca30-4145-b695-b2f7a81087b6 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:18.570430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2f85e9bf-ca30-4145-b695-b2f7a81087b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:18.660008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85e9bf-ca30-4145-b695-b2f7a81087b6 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:18.664071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154749ba-8931-49d3-b88f-2582c9394776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:18.664734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154749ba-8931-49d3-b88f-2582c9394776 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:18.665025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154749ba-8931-49d3-b88f-2582c9394776 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:18.665306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154749ba-8931-49d3-b88f-2582c9394776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:18.746781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154749ba-8931-49d3-b88f-2582c9394776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:18.748301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154749ba-8931-49d3-b88f-2582c9394776 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:18.759269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 922/1859] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:21.483958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8d67f-b506-43cd-9231-04b7b4be54f2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:21.493865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8d67f-b506-43cd-9231-04b7b4be54f2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:21.497658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91294ea1-633f-4d0e-ac29-7d8ec1101d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:21.498302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91294ea1-633f-4d0e-ac29-7d8ec1101d5b service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:21.498809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91294ea1-633f-4d0e-ac29-7d8ec1101d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:21.499311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91294ea1-633f-4d0e-ac29-7d8ec1101d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:21.512618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91294ea1-633f-4d0e-ac29-7d8ec1101d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:21.514602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91294ea1-633f-4d0e-ac29-7d8ec1101d5b service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:21.525892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 938/1860] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:28.754564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:31.522109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=73 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:32.150325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154749ba-8931-49d3-b88f-2582c9394776 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:32.161781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154749ba-8931-49d3-b88f-2582c9394776 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:32.169243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88034d38-7be5-4add-b3c0-d4d49b5ef278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:32.170420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034d38-7be5-4add-b3c0-d4d49b5ef278 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:32.170997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034d38-7be5-4add-b3c0-d4d49b5ef278 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:32.171501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034d38-7be5-4add-b3c0-d4d49b5ef278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:32.174976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-88034d38-7be5-4add-b3c0-d4d49b5ef278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:32.318744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88034d38-7be5-4add-b3c0-d4d49b5ef278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:32.320973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88034d38-7be5-4add-b3c0-d4d49b5ef278 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:32.340003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 923/1861] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:35.741644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91294ea1-633f-4d0e-ac29-7d8ec1101d5b service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:35.849891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91294ea1-633f-4d0e-ac29-7d8ec1101d5b service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:35.855428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:35.855635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:35.855867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:35.856144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] PATH_INFO: `/v3/users/b403594a2cf44a1b9b86111bd02e4d55` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:35.857332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b403594a2cf44a1b9b86111bd02e4d55)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:35.859329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:35.936149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b403594a2cf44a1b9b86111bd02e4d55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:35.959146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b403594a2cf44a1b9b86111bd02e4d55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:35.960251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b403594a2cf44a1b9b86111bd02e4d55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:35.979393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b403594a2cf44a1b9b86111bd02e4d55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:35.980309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b403594a2cf44a1b9b86111bd02e4d55'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:35.999064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 939/1862] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:35 2022] DELETE /identity/v3/users/b403594a2cf44a1b9b86111bd02e4d55 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:36.002429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468992d-3b3f-4b72-8a00-0224625e5faa None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:36.003035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468992d-3b3f-4b72-8a00-0224625e5faa None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:36.003137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468992d-3b3f-4b72-8a00-0224625e5faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:36.027065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c468992d-3b3f-4b72-8a00-0224625e5faa None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:36.028340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c468992d-3b3f-4b72-8a00-0224625e5faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:36.092219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 924/1863] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:36.102333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:36.106519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:36.173784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572942-f54a-4888-aece-49da314fc364 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:36.177974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d512784-e9ba-4acf-afc1-090466c31698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:36.178805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d512784-e9ba-4acf-afc1-090466c31698 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:36.179283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d512784-e9ba-4acf-afc1-090466c31698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:36.179741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d512784-e9ba-4acf-afc1-090466c31698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:36.191010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d512784-e9ba-4acf-afc1-090466c31698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:36.192831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d512784-e9ba-4acf-afc1-090466c31698 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:36.205300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 940/1864] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:36.704850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468992d-3b3f-4b72-8a00-0224625e5faa None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:36.706374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c468992d-3b3f-4b72-8a00-0224625e5faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:36.720906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468992d-3b3f-4b72-8a00-0224625e5faa None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:36.731949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:36.733093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:36.733598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:36.734107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] PATH_INFO: `/v3/projects/f9172ca666eb48d498585652c2a5d967` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:36.736533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9172ca666eb48d498585652c2a5d967)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:36.738712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:36.837941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9172ca666eb48d498585652c2a5d967', 'request_id': 'req-5b9edebb-fcc0-4221-9578-064761ad9238'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.850419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9172ca666eb48d498585652c2a5d967', 'request_id': 'req-5b9edebb-fcc0-4221-9578-064761ad9238'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.860457 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9172ca666eb48d498585652c2a5d967', 'request_id': 'req-5b9edebb-fcc0-4221-9578-064761ad9238'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.883853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] The token cache is being invalidate because project f9172ca666eb48d498585652c2a5d967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:36.884288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.885170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:36.887488 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 925/1865] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:36 2022] DELETE /identity/v3/projects/f9172ca666eb48d498585652c2a5d967 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:36.892173 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d512784-e9ba-4acf-afc1-090466c31698 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:36.904747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d512784-e9ba-4acf-afc1-090466c31698 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:36.925409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:36.982282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:36.983167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:36.983544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:36.983972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] PATH_INFO: `/v3/users/86ceaaa128144ba48b9d96d8a451d713` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:36.985453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ceaaa128144ba48b9d96d8a451d713)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:36.987536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:37.066268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ceaaa128144ba48b9d96d8a451d713'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:37.092874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ceaaa128144ba48b9d96d8a451d713'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:37.094048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ceaaa128144ba48b9d96d8a451d713'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:37.104213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ceaaa128144ba48b9d96d8a451d713'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:37.104965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-58c6ee92-a01c-4550-92b7-da576b9237e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ceaaa128144ba48b9d96d8a451d713'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:37.125070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 941/1866] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:36 2022] DELETE /identity/v3/users/86ceaaa128144ba48b9d96d8a451d713 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:37.720337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:37.722162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:37.743485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9edebb-fcc0-4221-9578-064761ad9238 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:37.763489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:37.873536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:37.874244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:37.874722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:37.875165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] PATH_INFO: `/v3/projects/d18ddd826ade4263ae400f94bbc9968e` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:37.876811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18ddd826ade4263ae400f94bbc9968e)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:37.878956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:37.993570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18ddd826ade4263ae400f94bbc9968e', 'request_id': 'req-1b47cd3b-38c4-48a2-b59e-1ec885c79623'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.009860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18ddd826ade4263ae400f94bbc9968e', 'request_id': 'req-1b47cd3b-38c4-48a2-b59e-1ec885c79623'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.024756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18ddd826ade4263ae400f94bbc9968e', 'request_id': 'req-1b47cd3b-38c4-48a2-b59e-1ec885c79623'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.052490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] The token cache is being invalidate because project d18ddd826ade4263ae400f94bbc9968e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:38.053590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.054311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1b47cd3b-38c4-48a2-b59e-1ec885c79623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:38.056292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 926/1867] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:37 2022] DELETE /identity/v3/projects/d18ddd826ade4263ae400f94bbc9968e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:38.066962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024068-c8cf-4ffa-bfc1-db898d9825c7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.067536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024068-c8cf-4ffa-bfc1-db898d9825c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.067536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51024068-c8cf-4ffa-bfc1-db898d9825c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.089194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-51024068-c8cf-4ffa-bfc1-db898d9825c7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:38.090547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-51024068-c8cf-4ffa-bfc1-db898d9825c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:38.175551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 942/1868] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:38.185203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e83e5-9b91-4db8-b951-377afa4c55e0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.185390 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e83e5-9b91-4db8-b951-377afa4c55e0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.185667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e83e5-9b91-4db8-b951-377afa4c55e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.210154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-6a8e83e5-9b91-4db8-b951-377afa4c55e0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:38.211427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6a8e83e5-9b91-4db8-b951-377afa4c55e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:38.220431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 927/1869] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:38.225315 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51024068-c8cf-4ffa-bfc1-db898d9825c7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.237962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51024068-c8cf-4ffa-bfc1-db898d9825c7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.243632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1394f-1426-4b3f-84b4-96ce3613b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.244350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1394f-1426-4b3f-84b4-96ce3613b514 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.253231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1394f-1426-4b3f-84b4-96ce3613b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.255194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1394f-1426-4b3f-84b4-96ce3613b514 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.257945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1394f-1426-4b3f-84b4-96ce3613b514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:38.258462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1394f-1426-4b3f-84b4-96ce3613b514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.260149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1394f-1426-4b3f-84b4-96ce3613b514 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.289579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 943/1870] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:38.294498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e83e5-9b91-4db8-b951-377afa4c55e0 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.308219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e83e5-9b91-4db8-b951-377afa4c55e0 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.315138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50767022-efcf-4b71-a87d-472f53a312af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.315694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50767022-efcf-4b71-a87d-472f53a312af admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.316019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50767022-efcf-4b71-a87d-472f53a312af admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.316334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50767022-efcf-4b71-a87d-472f53a312af admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.316961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50767022-efcf-4b71-a87d-472f53a312af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.318966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50767022-efcf-4b71-a87d-472f53a312af admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.354476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 928/1871] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:38.361328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1394f-1426-4b3f-84b4-96ce3613b514 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.381783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1394f-1426-4b3f-84b4-96ce3613b514 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.437829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:38.499345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c0805-95dd-4890-ac39-1171ccfe13c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.500040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c0805-95dd-4890-ac39-1171ccfe13c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.500474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c0805-95dd-4890-ac39-1171ccfe13c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.500787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c0805-95dd-4890-ac39-1171ccfe13c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.501697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c0805-95dd-4890-ac39-1171ccfe13c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.504797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c0805-95dd-4890-ac39-1171ccfe13c4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.552726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 944/1872] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:38.554483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50767022-efcf-4b71-a87d-472f53a312af admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.576849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50767022-efcf-4b71-a87d-472f53a312af admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.586470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6b7ab-2875-4913-86f3-169d32aac637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.587607 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6b7ab-2875-4913-86f3-169d32aac637 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.588297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6b7ab-2875-4913-86f3-169d32aac637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.588588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6b7ab-2875-4913-86f3-169d32aac637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.589916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6b7ab-2875-4913-86f3-169d32aac637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.591993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6b7ab-2875-4913-86f3-169d32aac637 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.609913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 929/1873] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:38.613212 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c0805-95dd-4890-ac39-1171ccfe13c4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.627309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c0805-95dd-4890-ac39-1171ccfe13c4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.633213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a68f-19a5-4e04-b0fc-91197d0ec953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.633802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a68f-19a5-4e04-b0fc-91197d0ec953 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.634090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a68f-19a5-4e04-b0fc-91197d0ec953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.634617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a68f-19a5-4e04-b0fc-91197d0ec953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.635136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237a68f-19a5-4e04-b0fc-91197d0ec953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.637038 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237a68f-19a5-4e04-b0fc-91197d0ec953 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.654709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 945/1874] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:38.660450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6b7ab-2875-4913-86f3-169d32aac637 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:38.692075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6b7ab-2875-4913-86f3-169d32aac637 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:38.699054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc68889-83dc-4c6c-a706-293e18b64e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:38.699908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc68889-83dc-4c6c-a706-293e18b64e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.700316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc68889-83dc-4c6c-a706-293e18b64e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.700690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc68889-83dc-4c6c-a706-293e18b64e2b admin admin] PATH_INFO: `/v3/projects/76bbe63ae95f437cbb28d5989ffa76fd/users/e5da61f8a9b342b581b16f12282da2d3/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.755073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc68889-83dc-4c6c-a706-293e18b64e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bbe63ae95f437cbb28d5989ffa76fd, user_id=e5da61f8a9b342b581b16f12282da2d3, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:38.765136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc68889-83dc-4c6c-a706-293e18b64e2b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:38.787073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 930/1875] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:38 2022] PUT /identity/v3/projects/76bbe63ae95f437cbb28d5989ffa76fd/users/e5da61f8a9b342b581b16f12282da2d3/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:38.795039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89174f-9054-4c64-b8d0-ea5334a044b3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:38.795521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89174f-9054-4c64-b8d0-ea5334a044b3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:38.796084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89174f-9054-4c64-b8d0-ea5334a044b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:38.855535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2b89174f-9054-4c64-b8d0-ea5334a044b3 None None] MFA Rules not processed for user `e5da61f8a9b342b581b16f12282da2d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:38.857825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2b89174f-9054-4c64-b8d0-ea5334a044b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:38.987688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 946/1876] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:38.988676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc68889-83dc-4c6c-a706-293e18b64e2b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:39.077787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:39.108896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc68889-83dc-4c6c-a706-293e18b64e2b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:39.117053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661f1c-d2a2-4b55-96ca-67fcb193f1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:39.117716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661f1c-d2a2-4b55-96ca-67fcb193f1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:39.119558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661f1c-d2a2-4b55-96ca-67fcb193f1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:39.119558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661f1c-d2a2-4b55-96ca-67fcb193f1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:39.119558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f661f1c-d2a2-4b55-96ca-67fcb193f1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:39.133744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f661f1c-d2a2-4b55-96ca-67fcb193f1e7 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:39.201891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 931/1877] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:38 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:39.206290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89174f-9054-4c64-b8d0-ea5334a044b3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:39.236899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89174f-9054-4c64-b8d0-ea5334a044b3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:39.343596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ba1bd-42ae-4679-871c-6db990beafa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:39.344758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ba1bd-42ae-4679-871c-6db990beafa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:39.345268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ba1bd-42ae-4679-871c-6db990beafa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:39.345722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ba1bd-42ae-4679-871c-6db990beafa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:39.346718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ba1bd-42ae-4679-871c-6db990beafa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:39.349709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ba1bd-42ae-4679-871c-6db990beafa4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:39.390660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 947/1878] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:39 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:39.394497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661f1c-d2a2-4b55-96ca-67fcb193f1e7 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:39.423385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661f1c-d2a2-4b55-96ca-67fcb193f1e7 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:39.442469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae085655-dfe6-4599-a473-6cfa04711f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:39.445793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae085655-dfe6-4599-a473-6cfa04711f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:39.446736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae085655-dfe6-4599-a473-6cfa04711f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:39.447470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae085655-dfe6-4599-a473-6cfa04711f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:39.449335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae085655-dfe6-4599-a473-6cfa04711f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:39.452959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae085655-dfe6-4599-a473-6cfa04711f94 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:39.476607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ba1bd-42ae-4679-871c-6db990beafa4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:39.478012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 932/1879] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:39.489471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ba1bd-42ae-4679-871c-6db990beafa4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:39.496960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabf62a-8a63-496b-be76-f7e0f79091f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:39.497989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf62a-8a63-496b-be76-f7e0f79091f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:39.498274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf62a-8a63-496b-be76-f7e0f79091f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:39.498555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf62a-8a63-496b-be76-f7e0f79091f9 admin admin] PATH_INFO: `/v3/projects/f8ec6672bc0f43519b0d16c8197a8188/users/f583792f031f4fba8d112878fbeed682/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:39.525850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabf62a-8a63-496b-be76-f7e0f79091f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ec6672bc0f43519b0d16c8197a8188, user_id=f583792f031f4fba8d112878fbeed682, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:39.530255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabf62a-8a63-496b-be76-f7e0f79091f9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:39.560827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 948/1880] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:39 2022] PUT /identity/v3/projects/f8ec6672bc0f43519b0d16c8197a8188/users/f583792f031f4fba8d112878fbeed682/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:39.562118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae085655-dfe6-4599-a473-6cfa04711f94 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:39.579487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae085655-dfe6-4599-a473-6cfa04711f94 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:39.738458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d22b0-2c99-47e9-800c-c1d1220f4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:39.739477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d22b0-2c99-47e9-800c-c1d1220f4cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:39.739951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d22b0-2c99-47e9-800c-c1d1220f4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:39.741090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d22b0-2c99-47e9-800c-c1d1220f4cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:39.741690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d22b0-2c99-47e9-800c-c1d1220f4cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:39.745031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d22b0-2c99-47e9-800c-c1d1220f4cc0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:39.766755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 933/1881] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:39.772134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabf62a-8a63-496b-be76-f7e0f79091f9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:39.788246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:39.796658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabf62a-8a63-496b-be76-f7e0f79091f9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:39.808279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5b5a-1f69-43d5-b059-22d72b78dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:39.809290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5b5a-1f69-43d5-b059-22d72b78dc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:39.810255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5b5a-1f69-43d5-b059-22d72b78dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:39.811415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5b5a-1f69-43d5-b059-22d72b78dc7b admin admin] PATH_INFO: `/v3/projects/f8ec6672bc0f43519b0d16c8197a8188/users/f583792f031f4fba8d112878fbeed682/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:39.817084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea5b5a-1f69-43d5-b059-22d72b78dc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ec6672bc0f43519b0d16c8197a8188, user_id=f583792f031f4fba8d112878fbeed682, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:39.823335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea5b5a-1f69-43d5-b059-22d72b78dc7b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:39.875234 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 949/1882] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:39 2022] PUT /identity/v3/projects/f8ec6672bc0f43519b0d16c8197a8188/users/f583792f031f4fba8d112878fbeed682/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:39.875384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15deaf-39d7-4a2a-ba99-2ae627550bf3 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:39.875384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15deaf-39d7-4a2a-ba99-2ae627550bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:39.875384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15deaf-39d7-4a2a-ba99-2ae627550bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:39.931216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5a15deaf-39d7-4a2a-ba99-2ae627550bf3 None None] MFA Rules not processed for user `f583792f031f4fba8d112878fbeed682`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:39.933968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5a15deaf-39d7-4a2a-ba99-2ae627550bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:40.091992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 934/1883] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:40.107330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5b5a-1f69-43d5-b059-22d72b78dc7b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:40.114573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-74ea5b5a-1f69-43d5-b059-22d72b78dc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:40.211448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5b5a-1f69-43d5-b059-22d72b78dc7b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:40.221390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ca777-3af2-47ca-97dd-caece902638f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:40.222182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca777-3af2-47ca-97dd-caece902638f service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:40.222558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca777-3af2-47ca-97dd-caece902638f service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:40.222958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca777-3af2-47ca-97dd-caece902638f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:40.243216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ca777-3af2-47ca-97dd-caece902638f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:40.245295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ca777-3af2-47ca-97dd-caece902638f service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:40.258768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 950/1884] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:40.321617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15deaf-39d7-4a2a-ba99-2ae627550bf3 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:40.419611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:40.450359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15deaf-39d7-4a2a-ba99-2ae627550bf3 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:40.455998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:40.456930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:40.457509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:40.457776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] PATH_INFO: `/v3/users/e5da61f8a9b342b581b16f12282da2d3` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:40.459195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5da61f8a9b342b581b16f12282da2d3)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:40.461267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:40.527696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5da61f8a9b342b581b16f12282da2d3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:40.528368 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5da61f8a9b342b581b16f12282da2d3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:40.543490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5da61f8a9b342b581b16f12282da2d3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:40.551736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5da61f8a9b342b581b16f12282da2d3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:40.552525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5da61f8a9b342b581b16f12282da2d3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:40.571539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 935/1885] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:40 2022] DELETE /identity/v3/users/e5da61f8a9b342b581b16f12282da2d3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:40.576314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c5d8-6c22-4eb8-8b51-99e211273aa1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:40.576594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c5d8-6c22-4eb8-8b51-99e211273aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:40.576902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0c5d8-6c22-4eb8-8b51-99e211273aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:40.598662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-22e0c5d8-6c22-4eb8-8b51-99e211273aa1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:40.599967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-22e0c5d8-6c22-4eb8-8b51-99e211273aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:40.673977 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 951/1886] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:40.686220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:40.688056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:40.761461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc417-659f-4048-a075-8144fe7c49d3 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:40.765579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce624254-934a-466c-afb7-02ec978cf5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:40.766365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624254-934a-466c-afb7-02ec978cf5dd service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:40.766562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624254-934a-466c-afb7-02ec978cf5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:40.766875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624254-934a-466c-afb7-02ec978cf5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:40.777501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce624254-934a-466c-afb7-02ec978cf5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:40.778983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce624254-934a-466c-afb7-02ec978cf5dd service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:40.789847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 936/1887] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:41.172939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c5d8-6c22-4eb8-8b51-99e211273aa1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:41.174693 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-22e0c5d8-6c22-4eb8-8b51-99e211273aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:41.193484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0c5d8-6c22-4eb8-8b51-99e211273aa1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:41.207083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:41.208043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:41.208518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:41.209200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] PATH_INFO: `/v3/projects/76bbe63ae95f437cbb28d5989ffa76fd` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:41.210300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bbe63ae95f437cbb28d5989ffa76fd)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:41.212686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:41.266261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bbe63ae95f437cbb28d5989ffa76fd', 'request_id': 'req-56a75642-2202-45fb-a2b8-db1905b8545e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.272405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bbe63ae95f437cbb28d5989ffa76fd', 'request_id': 'req-56a75642-2202-45fb-a2b8-db1905b8545e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.284749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bbe63ae95f437cbb28d5989ffa76fd', 'request_id': 'req-56a75642-2202-45fb-a2b8-db1905b8545e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.307290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] The token cache is being invalidate because project 76bbe63ae95f437cbb28d5989ffa76fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:41.308232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.309224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.310826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 952/1888] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:41 2022] DELETE /identity/v3/projects/76bbe63ae95f437cbb28d5989ffa76fd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:41.315499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce624254-934a-466c-afb7-02ec978cf5dd service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:41.326869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce624254-934a-466c-afb7-02ec978cf5dd service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:41.410543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:41.411297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:41.411741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:41.412014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] PATH_INFO: `/v3/users/f583792f031f4fba8d112878fbeed682` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:41.413314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f583792f031f4fba8d112878fbeed682)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:41.422129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:41.425265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:41.574971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f583792f031f4fba8d112878fbeed682'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.576380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f583792f031f4fba8d112878fbeed682'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.605521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f583792f031f4fba8d112878fbeed682'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.624940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f583792f031f4fba8d112878fbeed682'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.626014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1860767c-467d-4766-be9f-0541437c70c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f583792f031f4fba8d112878fbeed682'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:41.682769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 937/1889] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:41 2022] DELETE /identity/v3/users/f583792f031f4fba8d112878fbeed682 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:42.299619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:42.301787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:42.316589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75642-2202-45fb-a2b8-db1905b8545e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:42.332688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:42.382168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:42.382847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:42.383169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:42.383442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] PATH_INFO: `/v3/projects/f8ec6672bc0f43519b0d16c8197a8188` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:42.384723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ec6672bc0f43519b0d16c8197a8188)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:42.386773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:42.440650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ec6672bc0f43519b0d16c8197a8188', 'request_id': 'req-76935dde-b820-4954-906d-828f08f9481b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:42.446811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ec6672bc0f43519b0d16c8197a8188', 'request_id': 'req-76935dde-b820-4954-906d-828f08f9481b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:42.455947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ec6672bc0f43519b0d16c8197a8188', 'request_id': 'req-76935dde-b820-4954-906d-828f08f9481b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:42.469881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] The token cache is being invalidate because project f8ec6672bc0f43519b0d16c8197a8188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:42.470176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:42.470868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-76935dde-b820-4954-906d-828f08f9481b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:42.472475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 953/1890] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:42 2022] DELETE /identity/v3/projects/f8ec6672bc0f43519b0d16c8197a8188 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:42.477839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad273d-3a08-43a4-99b1-c5fddbd46951 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:42.478476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad273d-3a08-43a4-99b1-c5fddbd46951 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:42.478476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad273d-3a08-43a4-99b1-c5fddbd46951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:42.500160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-15ad273d-3a08-43a4-99b1-c5fddbd46951 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:42.501405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-15ad273d-3a08-43a4-99b1-c5fddbd46951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:42.585726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 938/1891] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:42.594960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9762f47-20be-4100-a73a-938ca02a6247 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:42.595266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9762f47-20be-4100-a73a-938ca02a6247 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:42.595565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9762f47-20be-4100-a73a-938ca02a6247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:42.619242 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e9762f47-20be-4100-a73a-938ca02a6247 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:42.620523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e9762f47-20be-4100-a73a-938ca02a6247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:42.629089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 954/1892] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:42.633676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad273d-3a08-43a4-99b1-c5fddbd46951 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:42.644746 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad273d-3a08-43a4-99b1-c5fddbd46951 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:42.650120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355704f-21bd-4408-9fc6-ee00efbbd836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:42.650758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355704f-21bd-4408-9fc6-ee00efbbd836 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:42.651769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355704f-21bd-4408-9fc6-ee00efbbd836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:42.652050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355704f-21bd-4408-9fc6-ee00efbbd836 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:42.652729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355704f-21bd-4408-9fc6-ee00efbbd836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:42.653035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355704f-21bd-4408-9fc6-ee00efbbd836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:42.654669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355704f-21bd-4408-9fc6-ee00efbbd836 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:42.669300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 939/1893] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:42.674014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9762f47-20be-4100-a73a-938ca02a6247 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:42.684763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9762f47-20be-4100-a73a-938ca02a6247 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:42.691627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810dac8-8ed1-4f17-8517-f83827847769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:42.692295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810dac8-8ed1-4f17-8517-f83827847769 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:42.692574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810dac8-8ed1-4f17-8517-f83827847769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:42.692841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810dac8-8ed1-4f17-8517-f83827847769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:42.693483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810dac8-8ed1-4f17-8517-f83827847769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:42.695438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810dac8-8ed1-4f17-8517-f83827847769 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:42.738256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 955/1894] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:42 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:42.743388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355704f-21bd-4408-9fc6-ee00efbbd836 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:42.759984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355704f-21bd-4408-9fc6-ee00efbbd836 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:42.883244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0901fe-ab34-4c99-a135-3fcfeeb77c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:42.884462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0901fe-ab34-4c99-a135-3fcfeeb77c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:42.884906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0901fe-ab34-4c99-a135-3fcfeeb77c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:42.885941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0901fe-ab34-4c99-a135-3fcfeeb77c39 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:42.887183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0901fe-ab34-4c99-a135-3fcfeeb77c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:42.891120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0901fe-ab34-4c99-a135-3fcfeeb77c39 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:42.926191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:42.934951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 940/1895] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:42 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:42.940706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810dac8-8ed1-4f17-8517-f83827847769 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:42.961752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810dac8-8ed1-4f17-8517-f83827847769 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:42.969091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101e331-db35-4134-b305-ad3bdd6a2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:42.969914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101e331-db35-4134-b305-ad3bdd6a2658 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:42.970209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101e331-db35-4134-b305-ad3bdd6a2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:42.970472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101e331-db35-4134-b305-ad3bdd6a2658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:42.971174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101e331-db35-4134-b305-ad3bdd6a2658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:42.972900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101e331-db35-4134-b305-ad3bdd6a2658 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:42.987442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 956/1896] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:42.992688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0901fe-ab34-4c99-a135-3fcfeeb77c39 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:43.014681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0901fe-ab34-4c99-a135-3fcfeeb77c39 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:43.021053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20614dd-23f0-43b5-9927-4933867961fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:43.021655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20614dd-23f0-43b5-9927-4933867961fb admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:43.022204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20614dd-23f0-43b5-9927-4933867961fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:43.022560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20614dd-23f0-43b5-9927-4933867961fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:43.023447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20614dd-23f0-43b5-9927-4933867961fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:43.026443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20614dd-23f0-43b5-9927-4933867961fb admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:43.046790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 941/1897] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:43.053026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101e331-db35-4134-b305-ad3bdd6a2658 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:43.072750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101e331-db35-4134-b305-ad3bdd6a2658 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:43.082387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a113b1f-eafc-4bcd-9f83-899dba2c89c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:43.083716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a113b1f-eafc-4bcd-9f83-899dba2c89c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:43.084410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a113b1f-eafc-4bcd-9f83-899dba2c89c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:43.084974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a113b1f-eafc-4bcd-9f83-899dba2c89c0 admin admin] PATH_INFO: `/v3/projects/46808ad37c764249a7d90cf3c9d8ea69/users/f7cce22fd50d4e3e9813cfc87d44a791/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:43.107992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a113b1f-eafc-4bcd-9f83-899dba2c89c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46808ad37c764249a7d90cf3c9d8ea69, user_id=f7cce22fd50d4e3e9813cfc87d44a791, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:43.111779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a113b1f-eafc-4bcd-9f83-899dba2c89c0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:43.129998 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 957/1898] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:43 2022] PUT /identity/v3/projects/46808ad37c764249a7d90cf3c9d8ea69/users/f7cce22fd50d4e3e9813cfc87d44a791/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:43.140981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470f2fa-8a91-4ce2-a8f0-a39430888b3f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:43.141266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470f2fa-8a91-4ce2-a8f0-a39430888b3f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:43.141541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470f2fa-8a91-4ce2-a8f0-a39430888b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:43.177425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5470f2fa-8a91-4ce2-a8f0-a39430888b3f None None] MFA Rules not processed for user `f7cce22fd50d4e3e9813cfc87d44a791`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:43.178758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5470f2fa-8a91-4ce2-a8f0-a39430888b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:43.267874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 942/1899] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:43.285621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a113b1f-eafc-4bcd-9f83-899dba2c89c0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:43.288533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4a113b1f-eafc-4bcd-9f83-899dba2c89c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:43.375246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:43.396579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a113b1f-eafc-4bcd-9f83-899dba2c89c0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:43.400817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1ea9-738d-4d0f-8fcd-d891dd4c2324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:43.402044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1ea9-738d-4d0f-8fcd-d891dd4c2324 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:43.402325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1ea9-738d-4d0f-8fcd-d891dd4c2324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:43.402595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1ea9-738d-4d0f-8fcd-d891dd4c2324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:43.411804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d1ea9-738d-4d0f-8fcd-d891dd4c2324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:43.413432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d1ea9-738d-4d0f-8fcd-d891dd4c2324 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:43.424144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 958/1900] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:47.921517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470f2fa-8a91-4ce2-a8f0-a39430888b3f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:48.002525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470f2fa-8a91-4ce2-a8f0-a39430888b3f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:48.007230 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:48.007961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:48.008249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:48.008941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] PATH_INFO: `/v3/users/f7cce22fd50d4e3e9813cfc87d44a791` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:48.009729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cce22fd50d4e3e9813cfc87d44a791)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:48.012162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:48.063743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cce22fd50d4e3e9813cfc87d44a791'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:48.064420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cce22fd50d4e3e9813cfc87d44a791'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:48.077876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cce22fd50d4e3e9813cfc87d44a791'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:48.086562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cce22fd50d4e3e9813cfc87d44a791'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:48.087282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cce22fd50d4e3e9813cfc87d44a791'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:48.093299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:48.105313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 943/1901] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:47 2022] DELETE /identity/v3/users/f7cce22fd50d4e3e9813cfc87d44a791 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:48.109605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd8fd-a53a-4aa4-ad29-fed8a8519f99 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:48.110128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd8fd-a53a-4aa4-ad29-fed8a8519f99 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:48.110206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bd8fd-a53a-4aa4-ad29-fed8a8519f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:48.131370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a86bd8fd-a53a-4aa4-ad29-fed8a8519f99 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:48.132625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a86bd8fd-a53a-4aa4-ad29-fed8a8519f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:48.222773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 959/1902] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:48.236169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:48.237847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:48.362177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5a48f-ae70-486a-b771-1489c30def84 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:48.371406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff5bc0-0a3d-40a3-b3c7-c004bb525f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:48.373100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5bc0-0a3d-40a3-b3c7-c004bb525f79 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:48.373612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5bc0-0a3d-40a3-b3c7-c004bb525f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:48.374207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5bc0-0a3d-40a3-b3c7-c004bb525f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:48.401969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff5bc0-0a3d-40a3-b3c7-c004bb525f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:48.404850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff5bc0-0a3d-40a3-b3c7-c004bb525f79 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:48.421838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 944/1903] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:48.985079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd8fd-a53a-4aa4-ad29-fed8a8519f99 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:48.987103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a86bd8fd-a53a-4aa4-ad29-fed8a8519f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:49.024163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bd8fd-a53a-4aa4-ad29-fed8a8519f99 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:49.032467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:49.033155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.033434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.033893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] PATH_INFO: `/v3/projects/46808ad37c764249a7d90cf3c9d8ea69` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.035294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46808ad37c764249a7d90cf3c9d8ea69)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:49.037949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:49.105870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46808ad37c764249a7d90cf3c9d8ea69', 'request_id': 'req-e75cfbd4-60a7-4630-b542-4a37e35e98d8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:49.113020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46808ad37c764249a7d90cf3c9d8ea69', 'request_id': 'req-e75cfbd4-60a7-4630-b542-4a37e35e98d8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:49.125655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46808ad37c764249a7d90cf3c9d8ea69', 'request_id': 'req-e75cfbd4-60a7-4630-b542-4a37e35e98d8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:49.140964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] The token cache is being invalidate because project 46808ad37c764249a7d90cf3c9d8ea69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:49.141266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:49.141992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e75cfbd4-60a7-4630-b542-4a37e35e98d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:49.143573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 960/1904] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:48 2022] DELETE /identity/v3/projects/46808ad37c764249a7d90cf3c9d8ea69 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:49.149314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e4780-4186-4274-ae2a-7de3933c2bfa None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.149818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e4780-4186-4274-ae2a-7de3933c2bfa None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.149904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e4780-4186-4274-ae2a-7de3933c2bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.189047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-a16e4780-4186-4274-ae2a-7de3933c2bfa None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:49.190326 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a16e4780-4186-4274-ae2a-7de3933c2bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:49.367125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 945/1905] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:49.373165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ec66d-d63a-4117-b14c-7b977ded19ce None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.373726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ec66d-d63a-4117-b14c-7b977ded19ce None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.374010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ec66d-d63a-4117-b14c-7b977ded19ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.399307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-cc7ec66d-d63a-4117-b14c-7b977ded19ce None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:49.400878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cc7ec66d-d63a-4117-b14c-7b977ded19ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:49.419550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 961/1906] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:49.424401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e4780-4186-4274-ae2a-7de3933c2bfa None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:49.438849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e4780-4186-4274-ae2a-7de3933c2bfa None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:49.444265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb6741-fade-45e3-ba45-f7bcb4b27fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:49.444915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb6741-fade-45e3-ba45-f7bcb4b27fec admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.445373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb6741-fade-45e3-ba45-f7bcb4b27fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.445661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb6741-fade-45e3-ba45-f7bcb4b27fec admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.446357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb6741-fade-45e3-ba45-f7bcb4b27fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:49.446666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb6741-fade-45e3-ba45-f7bcb4b27fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:49.449310 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb6741-fade-45e3-ba45-f7bcb4b27fec admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:49.468838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 946/1907] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:49.474064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ec66d-d63a-4117-b14c-7b977ded19ce None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:49.484904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ec66d-d63a-4117-b14c-7b977ded19ce None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:49.490083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138138-225a-4554-917e-fd212287f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:49.490758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138138-225a-4554-917e-fd212287f0ba admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.491093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138138-225a-4554-917e-fd212287f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.491369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b138138-225a-4554-917e-fd212287f0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.492025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b138138-225a-4554-917e-fd212287f0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:49.494002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b138138-225a-4554-917e-fd212287f0ba admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:49.531830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 962/1908] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:49 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:49.533838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb6741-fade-45e3-ba45-f7bcb4b27fec admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:49.545146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb6741-fade-45e3-ba45-f7bcb4b27fec admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:49.612640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7e710-aa40-47b6-8a7b-c0ae81a0edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:49.613292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7e710-aa40-47b6-8a7b-c0ae81a0edf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.613581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7e710-aa40-47b6-8a7b-c0ae81a0edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.613868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7e710-aa40-47b6-8a7b-c0ae81a0edf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.614531 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7e710-aa40-47b6-8a7b-c0ae81a0edf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:49.616620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7e710-aa40-47b6-8a7b-c0ae81a0edf1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:49.645254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 947/1909] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:49 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:49.650110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138138-225a-4554-917e-fd212287f0ba admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:49.663248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b138138-225a-4554-917e-fd212287f0ba admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:49.670697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681cab9-6495-44e0-a3e3-b08cf4e9cb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:49.672054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681cab9-6495-44e0-a3e3-b08cf4e9cb84 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.672341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681cab9-6495-44e0-a3e3-b08cf4e9cb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.672621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681cab9-6495-44e0-a3e3-b08cf4e9cb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.673327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681cab9-6495-44e0-a3e3-b08cf4e9cb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:49.675001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681cab9-6495-44e0-a3e3-b08cf4e9cb84 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:49.702358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 963/1910] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:49.703865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7e710-aa40-47b6-8a7b-c0ae81a0edf1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:49.719348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7e710-aa40-47b6-8a7b-c0ae81a0edf1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:49.725725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f534c-9423-4399-a371-74b8eb6ae31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:49.726782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f534c-9423-4399-a371-74b8eb6ae31c admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.730697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f534c-9423-4399-a371-74b8eb6ae31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.730697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f534c-9423-4399-a371-74b8eb6ae31c admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.730697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f534c-9423-4399-a371-74b8eb6ae31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:49.730697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f534c-9423-4399-a371-74b8eb6ae31c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:49.750793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 948/1911] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:49.752211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681cab9-6495-44e0-a3e3-b08cf4e9cb84 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:49.776716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f534c-9423-4399-a371-74b8eb6ae31c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:49.780041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-303f534c-9423-4399-a371-74b8eb6ae31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:49.802309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:49.802595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681cab9-6495-44e0-a3e3-b08cf4e9cb84 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:49.808356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f534c-9423-4399-a371-74b8eb6ae31c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:49.825377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:49.826454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.826621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.826996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] PATH_INFO: `/v3/users/da825ccdd5b34a22a0b74865d7215624` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.828125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da825ccdd5b34a22a0b74865d7215624)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:49.830199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:49.831043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3beb2d-57ff-4f5c-8ce0-51a1259a178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:49.834554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3beb2d-57ff-4f5c-8ce0-51a1259a178c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.835105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3beb2d-57ff-4f5c-8ce0-51a1259a178c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.835579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3beb2d-57ff-4f5c-8ce0-51a1259a178c admin admin] PATH_INFO: `/v3/projects/a734d7e72d9b4ad28f260e29e3892b31/users/4394746a81904eefa787fc2ef8a472d1/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.860933 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3beb2d-57ff-4f5c-8ce0-51a1259a178c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a734d7e72d9b4ad28f260e29e3892b31, user_id=4394746a81904eefa787fc2ef8a472d1, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:49.864280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3beb2d-57ff-4f5c-8ce0-51a1259a178c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:49.893576 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 964/1912] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:49 2022] PUT /identity/v3/projects/a734d7e72d9b4ad28f260e29e3892b31/users/4394746a81904eefa787fc2ef8a472d1/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:49.918463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edcf6f-5618-459a-89ef-d41b0a38b1d6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:49.922694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edcf6f-5618-459a-89ef-d41b0a38b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:49.923515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edcf6f-5618-459a-89ef-d41b0a38b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:49.948077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da825ccdd5b34a22a0b74865d7215624'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:49.948788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da825ccdd5b34a22a0b74865d7215624'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:49.951618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:49.976148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da825ccdd5b34a22a0b74865d7215624'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:49.995343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-03edcf6f-5618-459a-89ef-d41b0a38b1d6 None None] MFA Rules not processed for user `4394746a81904eefa787fc2ef8a472d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:49.999646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da825ccdd5b34a22a0b74865d7215624'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:50.000871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-03edcf6f-5618-459a-89ef-d41b0a38b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:50.001611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-0884d5fc-c968-49a2-883b-4d156db69805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da825ccdd5b34a22a0b74865d7215624'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:50.023365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 949/1913] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:49 2022] DELETE /identity/v3/users/da825ccdd5b34a22a0b74865d7215624 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:50.028150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4516c-d1f6-4752-bc4d-677deadf85d9 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:50.028576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4516c-d1f6-4752-bc4d-677deadf85d9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:50.028952 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4516c-d1f6-4752-bc4d-677deadf85d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:50.052501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8fc4516c-d1f6-4752-bc4d-677deadf85d9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:50.053917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8fc4516c-d1f6-4752-bc4d-677deadf85d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:50.130270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 965/1914] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:50.148265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edcf6f-5618-459a-89ef-d41b0a38b1d6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:50.150850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-03edcf6f-5618-459a-89ef-d41b0a38b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:50.227856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 950/1915] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:50.235628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4516c-d1f6-4752-bc4d-677deadf85d9 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:50.237799 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8fc4516c-d1f6-4752-bc4d-677deadf85d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:50.259306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edcf6f-5618-459a-89ef-d41b0a38b1d6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:50.343406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4516c-d1f6-4752-bc4d-677deadf85d9 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:50.347715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f1d6c-4b33-4360-bdb8-1a892d8c24a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:50.355392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f1d6c-4b33-4360-bdb8-1a892d8c24a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:50.356404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f1d6c-4b33-4360-bdb8-1a892d8c24a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:50.357794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f1d6c-4b33-4360-bdb8-1a892d8c24a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:50.369923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106d6b7-c358-4b45-a95f-1c5e1eb81f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:50.370963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106d6b7-c358-4b45-a95f-1c5e1eb81f6c service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:50.371484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106d6b7-c358-4b45-a95f-1c5e1eb81f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:50.372112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106d6b7-c358-4b45-a95f-1c5e1eb81f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:50.384009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f1d6c-4b33-4360-bdb8-1a892d8c24a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:50.386115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f1d6c-4b33-4360-bdb8-1a892d8c24a9 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:50.398355 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 951/1916] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:50.483936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106d6b7-c358-4b45-a95f-1c5e1eb81f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:50.487389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106d6b7-c358-4b45-a95f-1c5e1eb81f6c service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:50.500235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 966/1917] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:50.929483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f1d6c-4b33-4360-bdb8-1a892d8c24a9 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:50.929483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-356f1d6c-4b33-4360-bdb8-1a892d8c24a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:50.958798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f1d6c-4b33-4360-bdb8-1a892d8c24a9 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:50.977163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7ca7-6e3d-4219-b86d-78a5ee339abc None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:50.977420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:50.978270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:50.978857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:50.980023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] PATH_INFO: `/v3/projects/b04e219af46a40d68e068d76b848d76b` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:50.981110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7ca7-6e3d-4219-b86d-78a5ee339abc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:50.981709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7ca7-6e3d-4219-b86d-78a5ee339abc None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:50.982021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04e219af46a40d68e068d76b848d76b)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:50.985262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 967/1918] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:41:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:41:50.985781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:50.999283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754bb9f-2a7a-41cf-9013-487c635bfe79 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.000369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754bb9f-2a7a-41cf-9013-487c635bfe79 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.001324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754bb9f-2a7a-41cf-9013-487c635bfe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.013920 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:51.025252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:51.032105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6754bb9f-2a7a-41cf-9013-487c635bfe79 None None] MFA Rules not processed for user `8d086e815c1542d1ba9daf81e644166a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:51.034288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6754bb9f-2a7a-41cf-9013-487c635bfe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.073687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04e219af46a40d68e068d76b848d76b', 'request_id': 'req-22809e95-981f-4a13-b79c-5378e03941e4'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.081717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04e219af46a40d68e068d76b848d76b', 'request_id': 'req-22809e95-981f-4a13-b79c-5378e03941e4'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.091338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04e219af46a40d68e068d76b848d76b', 'request_id': 'req-22809e95-981f-4a13-b79c-5378e03941e4'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.103982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] The token cache is being invalidate because project b04e219af46a40d68e068d76b848d76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:51.104363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.106782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.108493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 952/1919] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:50 2022] DELETE /identity/v3/projects/b04e219af46a40d68e068d76b848d76b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:51.109397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.110896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.126132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 968/1920] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:41:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:51.127997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0ad4c-2884-46f5-a2b1-7b68cba6636a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.128292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0ad4c-2884-46f5-a2b1-7b68cba6636a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.128568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0ad4c-2884-46f5-a2b1-7b68cba6636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.151782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-09c0ad4c-2884-46f5-a2b1-7b68cba6636a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:51.152998 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-09c0ad4c-2884-46f5-a2b1-7b68cba6636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.181116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22809e95-981f-4a13-b79c-5378e03941e4 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.187128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.188099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.188387 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.188665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] PATH_INFO: `/v3/users/b18686529ecb4b5db2bd0648081c9c42` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.189873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18686529ecb4b5db2bd0648081c9c42)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.191894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.221841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 969/1921] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:51.222915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0ad4c-2884-46f5-a2b1-7b68cba6636a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.226064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-09c0ad4c-2884-46f5-a2b1-7b68cba6636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.257846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18686529ecb4b5db2bd0648081c9c42'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.258715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18686529ecb4b5db2bd0648081c9c42'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.274837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18686529ecb4b5db2bd0648081c9c42'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.289150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18686529ecb4b5db2bd0648081c9c42'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.290961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9e5fa721-f24f-4a10-8659-580184faccad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18686529ecb4b5db2bd0648081c9c42'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.307147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 953/1922] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:51 2022] DELETE /identity/v3/users/b18686529ecb4b5db2bd0648081c9c42 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:51.309125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18920-a4c5-41ba-a558-c77c3ad8fe35 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.309417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18920-a4c5-41ba-a558-c77c3ad8fe35 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.309696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18920-a4c5-41ba-a558-c77c3ad8fe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.342923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-09a18920-a4c5-41ba-a558-c77c3ad8fe35 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:51.344201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-09a18920-a4c5-41ba-a558-c77c3ad8fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.363040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0ad4c-2884-46f5-a2b1-7b68cba6636a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.367937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:51.454078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:51.462680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 954/1923] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:51.467919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18920-a4c5-41ba-a558-c77c3ad8fe35 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.484331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18920-a4c5-41ba-a558-c77c3ad8fe35 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.484536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.485254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.485719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.485992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.488760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.498581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7cd65-524e-4563-b316-ce839ed23168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.499309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7cd65-524e-4563-b316-ce839ed23168 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.499589 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7cd65-524e-4563-b316-ce839ed23168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.500373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7cd65-524e-4563-b316-ce839ed23168 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.501088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7cd65-524e-4563-b316-ce839ed23168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:51.501224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7cd65-524e-4563-b316-ce839ed23168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.503277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f7cd65-524e-4563-b316-ce839ed23168 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.503783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.507799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.521229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 955/1924] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:41:51.526569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 970/1925] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:51.535784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7cd65-524e-4563-b316-ce839ed23168 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.559090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7cd65-524e-4563-b316-ce839ed23168 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.568993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c54ec1-516b-4305-a86b-e21fc7deabe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.569712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c54ec1-516b-4305-a86b-e21fc7deabe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.570141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c54ec1-516b-4305-a86b-e21fc7deabe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.570541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c54ec1-516b-4305-a86b-e21fc7deabe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.571411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c54ec1-516b-4305-a86b-e21fc7deabe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.573182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.574807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c54ec1-516b-4305-a86b-e21fc7deabe2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.575361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.592346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4f4e0-d1e4-400b-9c43-9281833c9804 service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.600374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.601506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.601506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.601790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] PATH_INFO: `/v3/projects/ee657d7927d24daa9269f9c1338067d9` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.603135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee657d7927d24daa9269f9c1338067d9)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.605426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.633000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 956/1926] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:51 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:51.639250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c54ec1-516b-4305-a86b-e21fc7deabe2 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.697164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee657d7927d24daa9269f9c1338067d9', 'request_id': 'req-25b7e5d4-ef28-4c22-b9d3-09058993e62e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.709666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee657d7927d24daa9269f9c1338067d9', 'request_id': 'req-25b7e5d4-ef28-4c22-b9d3-09058993e62e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.721789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee657d7927d24daa9269f9c1338067d9', 'request_id': 'req-25b7e5d4-ef28-4c22-b9d3-09058993e62e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.755170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] The token cache is being invalidate because project ee657d7927d24daa9269f9c1338067d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:51.755170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.755548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-25b7e5d4-ef28-4c22-b9d3-09058993e62e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:51.757892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 971/1927] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:51 2022] DELETE /identity/v3/projects/ee657d7927d24daa9269f9c1338067d9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:51.764694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895b79a-6e01-410e-9c73-a937a41db227 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.765025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895b79a-6e01-410e-9c73-a937a41db227 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.765260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895b79a-6e01-410e-9c73-a937a41db227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.789126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c54ec1-516b-4305-a86b-e21fc7deabe2 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.790622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4895b79a-6e01-410e-9c73-a937a41db227 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:51.792290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4895b79a-6e01-410e-9c73-a937a41db227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.861379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a733-0d95-4cc9-b3e2-a1562aeebde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.861993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a733-0d95-4cc9-b3e2-a1562aeebde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.862270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a733-0d95-4cc9-b3e2-a1562aeebde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.862540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297a733-0d95-4cc9-b3e2-a1562aeebde8 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.863195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a733-0d95-4cc9-b3e2-a1562aeebde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.864481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 972/1928] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:51.865321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297a733-0d95-4cc9-b3e2-a1562aeebde8 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.875548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f672-b6ef-4c86-b3cd-e4deefa5c2c7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.875839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f672-b6ef-4c86-b3cd-e4deefa5c2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.876116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f672-b6ef-4c86-b3cd-e4deefa5c2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.890060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 957/1929] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:51 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:51.894756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a733-0d95-4cc9-b3e2-a1562aeebde8 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.896667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5297a733-0d95-4cc9-b3e2-a1562aeebde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.900099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2414f672-b6ef-4c86-b3cd-e4deefa5c2c7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:51.901330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2414f672-b6ef-4c86-b3cd-e4deefa5c2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:51.909032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297a733-0d95-4cc9-b3e2-a1562aeebde8 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.910213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 973/1930] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:51.913874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84edea-78e7-4658-a3d7-3cbfef39be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.914489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84edea-78e7-4658-a3d7-3cbfef39be0d admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.914614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f672-b6ef-4c86-b3cd-e4deefa5c2c7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.914767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84edea-78e7-4658-a3d7-3cbfef39be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.915068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84edea-78e7-4658-a3d7-3cbfef39be0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.915727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84edea-78e7-4658-a3d7-3cbfef39be0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.917978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84edea-78e7-4658-a3d7-3cbfef39be0d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.924578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f672-b6ef-4c86-b3cd-e4deefa5c2c7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.934037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 958/1931] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:51.934241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7548d-d44d-4e76-a17a-2f7a71baca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.934241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7548d-d44d-4e76-a17a-2f7a71baca33 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.934241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7548d-d44d-4e76-a17a-2f7a71baca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.934241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7548d-d44d-4e76-a17a-2f7a71baca33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.934572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7548d-d44d-4e76-a17a-2f7a71baca33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:51.934572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7548d-d44d-4e76-a17a-2f7a71baca33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.935297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84edea-78e7-4658-a3d7-3cbfef39be0d admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.936092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7548d-d44d-4e76-a17a-2f7a71baca33 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.945734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84edea-78e7-4658-a3d7-3cbfef39be0d admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.949115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 974/1932] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:41:51.955166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7548d-d44d-4e76-a17a-2f7a71baca33 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.955688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d0125-7860-44fa-9c3e-cc997c0e7785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.956324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0125-7860-44fa-9c3e-cc997c0e7785 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.956610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0125-7860-44fa-9c3e-cc997c0e7785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.956891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0125-7860-44fa-9c3e-cc997c0e7785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.957555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d0125-7860-44fa-9c3e-cc997c0e7785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.959236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d0125-7860-44fa-9c3e-cc997c0e7785 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.966162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7548d-d44d-4e76-a17a-2f7a71baca33 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:51.975388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 959/1933] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:51.976684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559314-dc33-4dd1-8a4c-bd315723ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:51.976684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559314-dc33-4dd1-8a4c-bd315723ce69 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:51.976684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559314-dc33-4dd1-8a4c-bd315723ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:51.976684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559314-dc33-4dd1-8a4c-bd315723ce69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:51.977291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559314-dc33-4dd1-8a4c-bd315723ce69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:51.977291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559314-dc33-4dd1-8a4c-bd315723ce69 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:51.982053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d0125-7860-44fa-9c3e-cc997c0e7785 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:51.988298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:51.998012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d0125-7860-44fa-9c3e-cc997c0e7785 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:52.005998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3783e5-d32c-4461-9831-e4e5b592c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:52.006649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3783e5-d32c-4461-9831-e4e5b592c586 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.006958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3783e5-d32c-4461-9831-e4e5b592c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.007232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3783e5-d32c-4461-9831-e4e5b592c586 admin admin] PATH_INFO: `/v3/projects/5d25865d4b1f4ea79662031602b4c972/users/f9d85b3b40084ce9a1cca4378fae20ae/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.011518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 975/1934] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:51 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:52.018050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559314-dc33-4dd1-8a4c-bd315723ce69 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:52.030598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3783e5-d32c-4461-9831-e4e5b592c586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d25865d4b1f4ea79662031602b4c972, user_id=f9d85b3b40084ce9a1cca4378fae20ae, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:52.033334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3783e5-d32c-4461-9831-e4e5b592c586 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:52.048495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 960/1935] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:51 2022] PUT /identity/v3/projects/5d25865d4b1f4ea79662031602b4c972/users/f9d85b3b40084ce9a1cca4378fae20ae/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:52.054321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:52.065716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037d2d-81e8-47f2-910e-f268670badd1 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.066221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037d2d-81e8-47f2-910e-f268670badd1 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.066686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037d2d-81e8-47f2-910e-f268670badd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.101918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-85037d2d-81e8-47f2-910e-f268670badd1 None None] MFA Rules not processed for user `f9d85b3b40084ce9a1cca4378fae20ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:52.103249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-85037d2d-81e8-47f2-910e-f268670badd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:52.120289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559314-dc33-4dd1-8a4c-bd315723ce69 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:52.200853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 961/1936] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:52.213410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a662ff-5b72-4f41-a21f-b07846df3b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:52.214281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85037d2d-81e8-47f2-910e-f268670badd1 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:52.214725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a662ff-5b72-4f41-a21f-b07846df3b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.214884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a662ff-5b72-4f41-a21f-b07846df3b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.215295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a662ff-5b72-4f41-a21f-b07846df3b25 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.215615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-85037d2d-81e8-47f2-910e-f268670badd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:52.216125 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a662ff-5b72-4f41-a21f-b07846df3b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:52.218203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a662ff-5b72-4f41-a21f-b07846df3b25 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:52.243744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 976/1937] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:52 2022] POST /identity/v3/users => generated 284 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:52.251685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a662ff-5b72-4f41-a21f-b07846df3b25 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:52.262885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a662ff-5b72-4f41-a21f-b07846df3b25 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:52.268686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23c88c-9d55-4f96-9a34-acce714d87f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:52.269569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23c88c-9d55-4f96-9a34-acce714d87f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.269853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23c88c-9d55-4f96-9a34-acce714d87f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.270122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23c88c-9d55-4f96-9a34-acce714d87f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.271153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23c88c-9d55-4f96-9a34-acce714d87f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:52.273195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23c88c-9d55-4f96-9a34-acce714d87f2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:52.282629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85037d2d-81e8-47f2-910e-f268670badd1 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:52.287079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 977/1938] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:52.287228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82906188-ade3-4a14-a590-e5564c859f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:52.287228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82906188-ade3-4a14-a590-e5564c859f74 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.287470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82906188-ade3-4a14-a590-e5564c859f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.287763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82906188-ade3-4a14-a590-e5564c859f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.288860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23c88c-9d55-4f96-9a34-acce714d87f2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:52.296922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82906188-ade3-4a14-a590-e5564c859f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:52.298373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82906188-ade3-4a14-a590-e5564c859f74 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:52.299121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23c88c-9d55-4f96-9a34-acce714d87f2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:52.304279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0c62d-818b-4113-88ae-59c9a0b4f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:52.304884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0c62d-818b-4113-88ae-59c9a0b4f387 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.305168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0c62d-818b-4113-88ae-59c9a0b4f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.305443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0c62d-818b-4113-88ae-59c9a0b4f387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.306093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0c62d-818b-4113-88ae-59c9a0b4f387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:52.308302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0c62d-818b-4113-88ae-59c9a0b4f387 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:52.308450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 962/1939] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:41:52.322046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 978/1940] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:52.327099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82906188-ade3-4a14-a590-e5564c859f74 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:52.337248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0c62d-818b-4113-88ae-59c9a0b4f387 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:52.339513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82906188-ade3-4a14-a590-e5564c859f74 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:52.344370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84deb7-9105-4921-92fa-d922bd2f22c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:52.345047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84deb7-9105-4921-92fa-d922bd2f22c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.345324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84deb7-9105-4921-92fa-d922bd2f22c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.345601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84deb7-9105-4921-92fa-d922bd2f22c4 admin admin] PATH_INFO: `/v3/projects/5de41e06c92d424e8f7e4cc94d0c0b3f/users/1db21da578c9477b852aa8806a405e9e/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.348191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0c62d-818b-4113-88ae-59c9a0b4f387 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:52.355459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:52.356181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.356483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.356767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] PATH_INFO: `/v3/users/f9d85b3b40084ce9a1cca4378fae20ae` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.358352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d85b3b40084ce9a1cca4378fae20ae)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:52.360340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:52.362801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84deb7-9105-4921-92fa-d922bd2f22c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de41e06c92d424e8f7e4cc94d0c0b3f, user_id=1db21da578c9477b852aa8806a405e9e, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:52.366768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84deb7-9105-4921-92fa-d922bd2f22c4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:52.382924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 963/1941] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:52 2022] PUT /identity/v3/projects/5de41e06c92d424e8f7e4cc94d0c0b3f/users/1db21da578c9477b852aa8806a405e9e/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:52.396288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931906c0-1651-4a5d-87d3-e0b19e669a9d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.396654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931906c0-1651-4a5d-87d3-e0b19e669a9d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.397335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931906c0-1651-4a5d-87d3-e0b19e669a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.414013 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d85b3b40084ce9a1cca4378fae20ae'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:52.427660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d85b3b40084ce9a1cca4378fae20ae'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:52.428498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d85b3b40084ce9a1cca4378fae20ae'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:52.429866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-931906c0-1651-4a5d-87d3-e0b19e669a9d None None] MFA Rules not processed for user `1db21da578c9477b852aa8806a405e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:52.431387 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-931906c0-1651-4a5d-87d3-e0b19e669a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:52.437779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d85b3b40084ce9a1cca4378fae20ae'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:52.438512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-64bb1c1b-3031-43d9-8770-a4bc7aa1be03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d85b3b40084ce9a1cca4378fae20ae'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:52.452546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 979/1942] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:52 2022] DELETE /identity/v3/users/f9d85b3b40084ce9a1cca4378fae20ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:52.457162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2f03-ea7e-49d8-9a0e-1d1bbd4fedee None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.457576 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2f03-ea7e-49d8-9a0e-1d1bbd4fedee None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.457753 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb2f03-ea7e-49d8-9a0e-1d1bbd4fedee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.470551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:52.475261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:52.489388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-83eb2f03-ea7e-49d8-9a0e-1d1bbd4fedee None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:52.490633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-83eb2f03-ea7e-49d8-9a0e-1d1bbd4fedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:52.514911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 964/1943] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:52.527397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931906c0-1651-4a5d-87d3-e0b19e669a9d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:52.528898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-931906c0-1651-4a5d-87d3-e0b19e669a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:52.564328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 980/1944] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:52.574567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb2f03-ea7e-49d8-9a0e-1d1bbd4fedee None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:52.576277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-83eb2f03-ea7e-49d8-9a0e-1d1bbd4fedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:52.599131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931906c0-1651-4a5d-87d3-e0b19e669a9d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:52.641990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb2f03-ea7e-49d8-9a0e-1d1bbd4fedee None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:52.646112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c4530-c901-435a-aeb6-a816e99d538e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:52.646708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c4530-c901-435a-aeb6-a816e99d538e service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.647272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c4530-c901-435a-aeb6-a816e99d538e service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.647587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c4530-c901-435a-aeb6-a816e99d538e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.657405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c4530-c901-435a-aeb6-a816e99d538e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:52.658563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a8d35-b230-4091-a21b-f2a4d341db7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:52.658885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c4530-c901-435a-aeb6-a816e99d538e service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:52.659225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a8d35-b230-4091-a21b-f2a4d341db7d service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:52.659512 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a8d35-b230-4091-a21b-f2a4d341db7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:52.659792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a8d35-b230-4091-a21b-f2a4d341db7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:52.676677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 981/1945] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:41:52.724582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a8d35-b230-4091-a21b-f2a4d341db7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:52.725951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a8d35-b230-4091-a21b-f2a4d341db7d service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:52.737726 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 965/1946] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:53.193249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c4530-c901-435a-aeb6-a816e99d538e service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:53.195624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cd5c4530-c901-435a-aeb6-a816e99d538e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:53.230418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c4530-c901-435a-aeb6-a816e99d538e service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:53.236018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:53.236569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.236851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.237121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] PATH_INFO: `/v3/projects/5d25865d4b1f4ea79662031602b4c972` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.238457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d25865d4b1f4ea79662031602b4c972)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:53.240644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:53.279370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a8d35-b230-4091-a21b-f2a4d341db7d service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:53.281014 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-419a8d35-b230-4091-a21b-f2a4d341db7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:53.302792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a8d35-b230-4091-a21b-f2a4d341db7d service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:53.305426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d25865d4b1f4ea79662031602b4c972', 'request_id': 'req-8ea8175b-6d3e-4def-a788-457fc278f699'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.312713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d25865d4b1f4ea79662031602b4c972', 'request_id': 'req-8ea8175b-6d3e-4def-a788-457fc278f699'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.321237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d25865d4b1f4ea79662031602b4c972', 'request_id': 'req-8ea8175b-6d3e-4def-a788-457fc278f699'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.333822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] The token cache is being invalidate because project 5d25865d4b1f4ea79662031602b4c972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:53.334113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.334791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8ea8175b-6d3e-4def-a788-457fc278f699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.336456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 982/1947] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:53 2022] DELETE /identity/v3/projects/5d25865d4b1f4ea79662031602b4c972 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:53.342920 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0a4e-2ef7-4760-b36c-44b343978cb5 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.343359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0a4e-2ef7-4760-b36c-44b343978cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.343636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0a4e-2ef7-4760-b36c-44b343978cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.362558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:53.367890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-869d0a4e-2ef7-4760-b36c-44b343978cb5 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:53.369275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-869d0a4e-2ef7-4760-b36c-44b343978cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:53.380621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:53.381677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.382157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.382693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] PATH_INFO: `/v3/users/4394746a81904eefa787fc2ef8a472d1` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.384686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4394746a81904eefa787fc2ef8a472d1)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:53.387988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:53.408536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:53.452887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4394746a81904eefa787fc2ef8a472d1'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.453538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4394746a81904eefa787fc2ef8a472d1'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.455509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 983/1948] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:53.465866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157f09-2eb4-4caa-9d10-2ec8a47b09e6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.465866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157f09-2eb4-4caa-9d10-2ec8a47b09e6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.465866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157f09-2eb4-4caa-9d10-2ec8a47b09e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.474629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4394746a81904eefa787fc2ef8a472d1'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.485721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-01157f09-2eb4-4caa-9d10-2ec8a47b09e6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:53.487190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-01157f09-2eb4-4caa-9d10-2ec8a47b09e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:53.487413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4394746a81904eefa787fc2ef8a472d1'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.488071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-08c7de5a-caad-4c85-995d-75ff4b82053f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4394746a81904eefa787fc2ef8a472d1'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:53.496882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 984/1949] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:53.500730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01157f09-2eb4-4caa-9d10-2ec8a47b09e6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:53.504807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 966/1950] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:41:53 2022] DELETE /identity/v3/users/4394746a81904eefa787fc2ef8a472d1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:53.509333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a887-7a04-4f51-8975-1d5bf69d3a7c None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.509621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a887-7a04-4f51-8975-1d5bf69d3a7c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.509900 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a887-7a04-4f51-8975-1d5bf69d3a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.514588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01157f09-2eb4-4caa-9d10-2ec8a47b09e6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:53.529929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-3908a887-7a04-4f51-8975-1d5bf69d3a7c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:53.531174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3908a887-7a04-4f51-8975-1d5bf69d3a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:53.586872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccd0b2-3607-4de3-a555-f9a90183fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:53.587524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccd0b2-3607-4de3-a555-f9a90183fa21 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.587808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccd0b2-3607-4de3-a555-f9a90183fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.588082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccd0b2-3607-4de3-a555-f9a90183fa21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.589540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccd0b2-3607-4de3-a555-f9a90183fa21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:53.589670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccd0b2-3607-4de3-a555-f9a90183fa21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:53.591220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccd0b2-3607-4de3-a555-f9a90183fa21 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:53.606969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 985/1951] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:41:53.609742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccd0b2-3607-4de3-a555-f9a90183fa21 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:53.616672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 967/1952] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:41:53.620305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccd0b2-3607-4de3-a555-f9a90183fa21 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:53.625466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc50d9-a6ec-4a15-8f9f-4675f3617422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:53.626190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc50d9-a6ec-4a15-8f9f-4675f3617422 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.626526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc50d9-a6ec-4a15-8f9f-4675f3617422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.626808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc50d9-a6ec-4a15-8f9f-4675f3617422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.627506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc50d9-a6ec-4a15-8f9f-4675f3617422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:53.629740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908a887-7a04-4f51-8975-1d5bf69d3a7c None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:53.629979 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc50d9-a6ec-4a15-8f9f-4675f3617422 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:53.631972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3908a887-7a04-4f51-8975-1d5bf69d3a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:53.661522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 986/1953] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:53 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:53.667546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc50d9-a6ec-4a15-8f9f-4675f3617422 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:53.710535 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908a887-7a04-4f51-8975-1d5bf69d3a7c None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:53.732612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:53.742500 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc50d9-a6ec-4a15-8f9f-4675f3617422 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:53.748972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa521d3-91ff-40dc-af4e-5eefff73033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:53.750025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa521d3-91ff-40dc-af4e-5eefff73033d admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.750505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa521d3-91ff-40dc-af4e-5eefff73033d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.751012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa521d3-91ff-40dc-af4e-5eefff73033d admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.751857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa521d3-91ff-40dc-af4e-5eefff73033d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:53.754524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa521d3-91ff-40dc-af4e-5eefff73033d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:53.780619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e28d86-40d4-45b4-ab15-e185288e4179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:53.781400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 987/1954] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:53 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:53.781515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e28d86-40d4-45b4-ab15-e185288e4179 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.781927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e28d86-40d4-45b4-ab15-e185288e4179 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.782220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e28d86-40d4-45b4-ab15-e185288e4179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.785201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa521d3-91ff-40dc-af4e-5eefff73033d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:53.793274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e28d86-40d4-45b4-ab15-e185288e4179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:53.794969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e28d86-40d4-45b4-ab15-e185288e4179 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:53.795115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa521d3-91ff-40dc-af4e-5eefff73033d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:53.800249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c71514-405c-4fd6-aab0-5db2535b1c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:53.800868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c71514-405c-4fd6-aab0-5db2535b1c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.801152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c71514-405c-4fd6-aab0-5db2535b1c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.801445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c71514-405c-4fd6-aab0-5db2535b1c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.802409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c71514-405c-4fd6-aab0-5db2535b1c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:53.803930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c71514-405c-4fd6-aab0-5db2535b1c8e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:53.808993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 968/1955] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:41:53.815531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 988/1956] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:53.819355 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e28d86-40d4-45b4-ab15-e185288e4179 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:53.830028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e28d86-40d4-45b4-ab15-e185288e4179 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:53.835587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4ced0-8013-4879-9661-d55551ce37cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:53.835990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4ced0-8013-4879-9661-d55551ce37cd admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.836344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4ced0-8013-4879-9661-d55551ce37cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.836689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4ced0-8013-4879-9661-d55551ce37cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.837557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4ced0-8013-4879-9661-d55551ce37cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:53.839129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4ced0-8013-4879-9661-d55551ce37cd admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:53.850998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 969/1957] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:41:53.854926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c71514-405c-4fd6-aab0-5db2535b1c8e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:53.866086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c71514-405c-4fd6-aab0-5db2535b1c8e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:53.872260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837bbc5-2aa6-4a3b-9b11-e1ec38d6ff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:53.873569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837bbc5-2aa6-4a3b-9b11-e1ec38d6ff96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.873974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837bbc5-2aa6-4a3b-9b11-e1ec38d6ff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.874306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837bbc5-2aa6-4a3b-9b11-e1ec38d6ff96 admin admin] PATH_INFO: `/v3/projects/023ff0ca5a0b4cf9b90a557e2b11cdcf/users/3226b4c9f79c48ff9574c2af20a41a73/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.889848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:53.895481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837bbc5-2aa6-4a3b-9b11-e1ec38d6ff96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023ff0ca5a0b4cf9b90a557e2b11cdcf, user_id=3226b4c9f79c48ff9574c2af20a41a73, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:53.898968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837bbc5-2aa6-4a3b-9b11-e1ec38d6ff96 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:53.913296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 989/1958] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:53 2022] PUT /identity/v3/projects/023ff0ca5a0b4cf9b90a557e2b11cdcf/users/3226b4c9f79c48ff9574c2af20a41a73/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:53.918666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203829-16dc-4d8c-a5a0-9fe33ba84ceb None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:53.918975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203829-16dc-4d8c-a5a0-9fe33ba84ceb None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:53.919246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203829-16dc-4d8c-a5a0-9fe33ba84ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:53.941233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c8203829-16dc-4d8c-a5a0-9fe33ba84ceb None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:53.942687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c8203829-16dc-4d8c-a5a0-9fe33ba84ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:54.017003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 970/1959] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:54.029689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837bbc5-2aa6-4a3b-9b11-e1ec38d6ff96 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:54.031480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4837bbc5-2aa6-4a3b-9b11-e1ec38d6ff96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:54.095636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837bbc5-2aa6-4a3b-9b11-e1ec38d6ff96 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:54.099870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d45f5-4c26-4169-b638-0e38290fe11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:54.100600 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d45f5-4c26-4169-b638-0e38290fe11f service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:54.100901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d45f5-4c26-4169-b638-0e38290fe11f service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:54.101160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d45f5-4c26-4169-b638-0e38290fe11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:54.109852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8203829-16dc-4d8c-a5a0-9fe33ba84ceb None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:54.111509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c8203829-16dc-4d8c-a5a0-9fe33ba84ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:54.113479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d45f5-4c26-4169-b638-0e38290fe11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:54.114966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d45f5-4c26-4169-b638-0e38290fe11f service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:54.124715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8203829-16dc-4d8c-a5a0-9fe33ba84ceb None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:54.129690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 990/1960] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:54.130534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:54.131414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:54.131886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:54.132168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] PATH_INFO: `/v3/projects/a734d7e72d9b4ad28f260e29e3892b31` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:54.133481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a734d7e72d9b4ad28f260e29e3892b31)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:54.135623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:54.262789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a734d7e72d9b4ad28f260e29e3892b31', 'request_id': 'req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:54.276165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a734d7e72d9b4ad28f260e29e3892b31', 'request_id': 'req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:54.287276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a734d7e72d9b4ad28f260e29e3892b31', 'request_id': 'req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:54.312762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] The token cache is being invalidate because project a734d7e72d9b4ad28f260e29e3892b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:41:54.313355 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:54.313808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c25ff611-e0c7-4955-b0fd-c769d24e3ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:41:54.315784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 971/1961] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:41:54 2022] DELETE /identity/v3/projects/a734d7e72d9b4ad28f260e29e3892b31 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:41:54.324205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c767-7735-4283-aed7-d09a70262448 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:54.324820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c767-7735-4283-aed7-d09a70262448 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:54.324820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280c767-7735-4283-aed7-d09a70262448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:54.359267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1280c767-7735-4283-aed7-d09a70262448 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:54.360660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1280c767-7735-4283-aed7-d09a70262448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:54.516760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 991/1962] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:54.526798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235f00-cada-4332-b1e1-cf3710ad5e6d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:54.527351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235f00-cada-4332-b1e1-cf3710ad5e6d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:54.527889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235f00-cada-4332-b1e1-cf3710ad5e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:54.555844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-75235f00-cada-4332-b1e1-cf3710ad5e6d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:54.558143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-75235f00-cada-4332-b1e1-cf3710ad5e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:54.569554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 972/1963] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:54.576194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280c767-7735-4283-aed7-d09a70262448 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:54.589143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280c767-7735-4283-aed7-d09a70262448 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:54.600269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd82fcd-a209-482e-988c-99715da07a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:54.600992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd82fcd-a209-482e-988c-99715da07a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:54.601183 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd82fcd-a209-482e-988c-99715da07a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:54.601473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd82fcd-a209-482e-988c-99715da07a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:54.602130 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd82fcd-a209-482e-988c-99715da07a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:41:54.602478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd82fcd-a209-482e-988c-99715da07a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:54.604029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd82fcd-a209-482e-988c-99715da07a22 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:54.630503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 992/1964] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:41:54.635890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75235f00-cada-4332-b1e1-cf3710ad5e6d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:54.652437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75235f00-cada-4332-b1e1-cf3710ad5e6d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:54.660157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35a22e-af8f-4460-b60e-9b72041aee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:54.660909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35a22e-af8f-4460-b60e-9b72041aee34 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:54.661471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35a22e-af8f-4460-b60e-9b72041aee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:54.662910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35a22e-af8f-4460-b60e-9b72041aee34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:54.664073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35a22e-af8f-4460-b60e-9b72041aee34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:54.668452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35a22e-af8f-4460-b60e-9b72041aee34 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:54.728309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 973/1965] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:41:54 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:41:54.733236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd82fcd-a209-482e-988c-99715da07a22 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:54.747456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd82fcd-a209-482e-988c-99715da07a22 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:54.873581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13df32-7a05-47c2-a7c7-2bd03dbf5c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:54.874655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13df32-7a05-47c2-a7c7-2bd03dbf5c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:54.875078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13df32-7a05-47c2-a7c7-2bd03dbf5c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:54.875441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13df32-7a05-47c2-a7c7-2bd03dbf5c7e admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:54.876134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13df32-7a05-47c2-a7c7-2bd03dbf5c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:54.878201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13df32-7a05-47c2-a7c7-2bd03dbf5c7e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:54.903858 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 993/1966] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:41:54 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:41:54.908260 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35a22e-af8f-4460-b60e-9b72041aee34 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:54.921692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35a22e-af8f-4460-b60e-9b72041aee34 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:54.928327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2affbc3-99d8-4153-9aea-67f066d20c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:54.928974 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2affbc3-99d8-4153-9aea-67f066d20c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:54.929452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2affbc3-99d8-4153-9aea-67f066d20c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:54.929736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2affbc3-99d8-4153-9aea-67f066d20c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:54.930418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2affbc3-99d8-4153-9aea-67f066d20c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:54.932133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2affbc3-99d8-4153-9aea-67f066d20c5d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:54.935336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:54.948409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 974/1967] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:54.949999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13df32-7a05-47c2-a7c7-2bd03dbf5c7e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:54.966249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13df32-7a05-47c2-a7c7-2bd03dbf5c7e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:54.971225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4195870-5965-4fca-9350-a9723c985dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:54.971957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4195870-5965-4fca-9350-a9723c985dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:54.972162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4195870-5965-4fca-9350-a9723c985dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:54.972440 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4195870-5965-4fca-9350-a9723c985dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:54.973169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4195870-5965-4fca-9350-a9723c985dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:54.974913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4195870-5965-4fca-9350-a9723c985dfd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:54.977607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:41:54.991892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 994/1968] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:41:54.993216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2affbc3-99d8-4153-9aea-67f066d20c5d admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:55.004855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2affbc3-99d8-4153-9aea-67f066d20c5d admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:55.010027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23857ec8-ac34-4a42-92a1-2082b8cc0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:55.010732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23857ec8-ac34-4a42-92a1-2082b8cc0119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:55.011047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23857ec8-ac34-4a42-92a1-2082b8cc0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:55.011330 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23857ec8-ac34-4a42-92a1-2082b8cc0119 admin admin] PATH_INFO: `/v3/projects/737e08f79dcf406e8d4ddde26e11cfa2/users/cfb9204220924a44a6bbda5e40b823d7/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:55.029248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23857ec8-ac34-4a42-92a1-2082b8cc0119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737e08f79dcf406e8d4ddde26e11cfa2, user_id=cfb9204220924a44a6bbda5e40b823d7, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:55.032166 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23857ec8-ac34-4a42-92a1-2082b8cc0119 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:55.047700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 975/1969] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:41:54 2022] PUT /identity/v3/projects/737e08f79dcf406e8d4ddde26e11cfa2/users/cfb9204220924a44a6bbda5e40b823d7/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:41:55.053081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b47a5-801a-4e22-9511-5ca4e3b833c0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:55.053368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b47a5-801a-4e22-9511-5ca4e3b833c0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:55.053644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b47a5-801a-4e22-9511-5ca4e3b833c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:55.076959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f25b47a5-801a-4e22-9511-5ca4e3b833c0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:55.078233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f25b47a5-801a-4e22-9511-5ca4e3b833c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:55.145166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 995/1970] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:55.155701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23857ec8-ac34-4a42-92a1-2082b8cc0119 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:55.157433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-23857ec8-ac34-4a42-92a1-2082b8cc0119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:55.223938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23857ec8-ac34-4a42-92a1-2082b8cc0119 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:55.231727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4b20e-b8c8-4d65-b655-4862c76ce9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:55.232354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4b20e-b8c8-4d65-b655-4862c76ce9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:55.232633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4b20e-b8c8-4d65-b655-4862c76ce9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:55.232903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4b20e-b8c8-4d65-b655-4862c76ce9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:55.242853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4b20e-b8c8-4d65-b655-4862c76ce9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:55.244331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4b20e-b8c8-4d65-b655-4862c76ce9b7 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:55.254914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 976/1971] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:41:56.355283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007bca6-0493-4dee-a50f-92f9817930b0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:56.357073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007bca6-0493-4dee-a50f-92f9817930b0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:56.357796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007bca6-0493-4dee-a50f-92f9817930b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:56.425293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6007bca6-0493-4dee-a50f-92f9817930b0 None None] MFA Rules not processed for user `cfb9204220924a44a6bbda5e40b823d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:56.428133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6007bca6-0493-4dee-a50f-92f9817930b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:56.650526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 996/1972] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:41:56.665183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4b20e-b8c8-4d65-b655-4862c76ce9b7 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:41:56.668277 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a5f4b20e-b8c8-4d65-b655-4862c76ce9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:56.864965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4b20e-b8c8-4d65-b655-4862c76ce9b7 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:41:56.889464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e888f-ad2e-4b53-a45c-ddbdf95e1007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:41:56.890505 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e888f-ad2e-4b53-a45c-ddbdf95e1007 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:56.891153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e888f-ad2e-4b53-a45c-ddbdf95e1007 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:56.891859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e888f-ad2e-4b53-a45c-ddbdf95e1007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:56.912204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e888f-ad2e-4b53-a45c-ddbdf95e1007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:41:56.915959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e888f-ad2e-4b53-a45c-ddbdf95e1007 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:41:56.947540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 977/1973] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:41:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:41:58.576886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47834f-34e1-450c-bb59-e577aee44aa8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:41:58.577545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47834f-34e1-450c-bb59-e577aee44aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:41:58.577545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47834f-34e1-450c-bb59-e577aee44aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:41:58.610547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9c47834f-34e1-450c-bb59-e577aee44aa8 None None] MFA Rules not processed for user `cfb9204220924a44a6bbda5e40b823d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:41:58.613220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9c47834f-34e1-450c-bb59-e577aee44aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:41:58.628669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 997/1974] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:42:01.408313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52428526-7169-43ca-8ce9-3305e55867f5 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:01.409793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52428526-7169-43ca-8ce9-3305e55867f5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:01.410569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52428526-7169-43ca-8ce9-3305e55867f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:01.507602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-52428526-7169-43ca-8ce9-3305e55867f5 None None] MFA Rules not processed for user `3226b4c9f79c48ff9574c2af20a41a73`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:01.509315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-52428526-7169-43ca-8ce9-3305e55867f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:01.708527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 978/1975] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:01.715902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47834f-34e1-450c-bb59-e577aee44aa8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:01.717568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9c47834f-34e1-450c-bb59-e577aee44aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:01.742034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47834f-34e1-450c-bb59-e577aee44aa8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:01.749777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb2ec6-e36c-4385-8902-f8b1f6b72a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:01.751295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb2ec6-e36c-4385-8902-f8b1f6b72a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:01.752164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb2ec6-e36c-4385-8902-f8b1f6b72a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:01.752826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb2ec6-e36c-4385-8902-f8b1f6b72a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:01.754131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb2ec6-e36c-4385-8902-f8b1f6b72a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:01.761317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb2ec6-e36c-4385-8902-f8b1f6b72a35 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:01.815987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 998/1976] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:01 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:01.820846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52428526-7169-43ca-8ce9-3305e55867f5 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:01.848984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52428526-7169-43ca-8ce9-3305e55867f5 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:01.870577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:01.959743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd238654-7215-46ad-96bd-49e214019f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:01.960286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd238654-7215-46ad-96bd-49e214019f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:01.960620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd238654-7215-46ad-96bd-49e214019f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:01.960897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd238654-7215-46ad-96bd-49e214019f41 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:01.961595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd238654-7215-46ad-96bd-49e214019f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:01.963814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd238654-7215-46ad-96bd-49e214019f41 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:01.995253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 979/1977] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:01 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:02.000624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb2ec6-e36c-4385-8902-f8b1f6b72a35 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:02.018627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb2ec6-e36c-4385-8902-f8b1f6b72a35 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:02.029309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93217d5c-23a2-4fdf-a9c3-bb4beac19cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:02.030379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93217d5c-23a2-4fdf-a9c3-bb4beac19cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:02.031087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93217d5c-23a2-4fdf-a9c3-bb4beac19cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:02.031795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93217d5c-23a2-4fdf-a9c3-bb4beac19cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:02.032901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93217d5c-23a2-4fdf-a9c3-bb4beac19cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:02.035110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93217d5c-23a2-4fdf-a9c3-bb4beac19cf0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:02.053715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 999/1978] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:02.055010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd238654-7215-46ad-96bd-49e214019f41 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:02.068176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd238654-7215-46ad-96bd-49e214019f41 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:02.075640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b808d4-d140-4717-910a-72200f0293b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:02.076231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b808d4-d140-4717-910a-72200f0293b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:02.076548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b808d4-d140-4717-910a-72200f0293b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:02.076884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b808d4-d140-4717-910a-72200f0293b6 admin admin] PATH_INFO: `/v3/projects/92c5f4e18e97474994c343d501352716/users/e1fef50560dc4be8a3fc95129e4a2c41/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:02.096329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b808d4-d140-4717-910a-72200f0293b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c5f4e18e97474994c343d501352716, user_id=e1fef50560dc4be8a3fc95129e4a2c41, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:02.099089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b808d4-d140-4717-910a-72200f0293b6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:02.114680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 980/1979] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:02 2022] PUT /identity/v3/projects/92c5f4e18e97474994c343d501352716/users/e1fef50560dc4be8a3fc95129e4a2c41/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:42:02.119213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93217d5c-23a2-4fdf-a9c3-bb4beac19cf0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:02.133603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93217d5c-23a2-4fdf-a9c3-bb4beac19cf0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:02.203503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:02.225342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a72285-e659-433e-b86a-5b7f5ccab3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:02.226288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a72285-e659-433e-b86a-5b7f5ccab3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:02.226627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a72285-e659-433e-b86a-5b7f5ccab3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:02.226967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a72285-e659-433e-b86a-5b7f5ccab3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:02.227673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a72285-e659-433e-b86a-5b7f5ccab3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:02.230738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a72285-e659-433e-b86a-5b7f5ccab3b3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:02.262993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1000/1980] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:02.267432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b808d4-d140-4717-910a-72200f0293b6 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:02.290181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b808d4-d140-4717-910a-72200f0293b6 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:02.296236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba81cb-380e-479a-b0f4-2a25cc9de029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:02.296930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba81cb-380e-479a-b0f4-2a25cc9de029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:02.297217 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba81cb-380e-479a-b0f4-2a25cc9de029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:02.297498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba81cb-380e-479a-b0f4-2a25cc9de029 admin admin] PATH_INFO: `/v3/projects/92c5f4e18e97474994c343d501352716/users/e1fef50560dc4be8a3fc95129e4a2c41/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:02.300538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba81cb-380e-479a-b0f4-2a25cc9de029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c5f4e18e97474994c343d501352716, user_id=e1fef50560dc4be8a3fc95129e4a2c41, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:02.303765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba81cb-380e-479a-b0f4-2a25cc9de029 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:02.335580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 981/1981] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:02 2022] PUT /identity/v3/projects/92c5f4e18e97474994c343d501352716/users/e1fef50560dc4be8a3fc95129e4a2c41/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:02.391477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a72285-e659-433e-b86a-5b7f5ccab3b3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:02.393766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-45a72285-e659-433e-b86a-5b7f5ccab3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:02.409714 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a72285-e659-433e-b86a-5b7f5ccab3b3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:02.525416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:02.526499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:02.527277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:02.527727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] PATH_INFO: `/v3/users/1cee8d97229f421899c131dc675609fa` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:02.529591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cee8d97229f421899c131dc675609fa)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:02.533274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:02.603681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cee8d97229f421899c131dc675609fa'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:02.619818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cee8d97229f421899c131dc675609fa'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:02.620579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cee8d97229f421899c131dc675609fa'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:02.629764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cee8d97229f421899c131dc675609fa'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:02.630409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cee8d97229f421899c131dc675609fa'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:02.651695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1001/1982] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:02 2022] DELETE /identity/v3/users/1cee8d97229f421899c131dc675609fa => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:02.908448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba81cb-380e-479a-b0f4-2a25cc9de029 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:02.910279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8aba81cb-380e-479a-b0f4-2a25cc9de029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:02.932933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba81cb-380e-479a-b0f4-2a25cc9de029 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:02.964521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:02.966147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:03.047207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:03.047973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:03.048295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:03.049126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] PATH_INFO: `/v3/projects/69bd99c9cf0945e3a48f62d679e999d6` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:03.051678 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bd99c9cf0945e3a48f62d679e999d6)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:03.061582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:03.108659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837541a-d7e7-42b2-939b-bb47a1611ac6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:03.114453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:03.115206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:03.115421 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:03.116146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] PATH_INFO: `/v3/users/1db21da578c9477b852aa8806a405e9e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:03.117466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db21da578c9477b852aa8806a405e9e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:03.120413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:03.127669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:03.132676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bd99c9cf0945e3a48f62d679e999d6', 'request_id': 'req-3f95fb62-3186-49e1-8be5-762b4072a7cf'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.148339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bd99c9cf0945e3a48f62d679e999d6', 'request_id': 'req-3f95fb62-3186-49e1-8be5-762b4072a7cf'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.157266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:03.158548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bd99c9cf0945e3a48f62d679e999d6', 'request_id': 'req-3f95fb62-3186-49e1-8be5-762b4072a7cf'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.181615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] The token cache is being invalidate because project 69bd99c9cf0945e3a48f62d679e999d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:03.182058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.183439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.185387 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 982/1983] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:02 2022] DELETE /identity/v3/projects/69bd99c9cf0945e3a48f62d679e999d6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:03.190284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:03.191335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:03.205553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db21da578c9477b852aa8806a405e9e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.222340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db21da578c9477b852aa8806a405e9e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.223538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db21da578c9477b852aa8806a405e9e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.243650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db21da578c9477b852aa8806a405e9e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.244386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d29eecf7-025e-445d-a397-f13ac61b2c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db21da578c9477b852aa8806a405e9e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.277400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1002/1984] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:02 2022] DELETE /identity/v3/users/1db21da578c9477b852aa8806a405e9e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:42:03.284668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593090d-f703-4a05-86bf-6027bd5818cc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:03.285091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593090d-f703-4a05-86bf-6027bd5818cc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:03.286090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593090d-f703-4a05-86bf-6027bd5818cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:03.333398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d593090d-f703-4a05-86bf-6027bd5818cc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:03.343707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d593090d-f703-4a05-86bf-6027bd5818cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:03.356361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95fb62-3186-49e1-8be5-762b4072a7cf admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:03.459139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:03.459676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:03.459961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:03.460242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] PATH_INFO: `/v3/users/af9ccd20d4224d7f8e61f02e19a053bb` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:03.462854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9ccd20d4224d7f8e61f02e19a053bb)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:03.466148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:03.479119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1003/1985] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:42:03.514053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593090d-f703-4a05-86bf-6027bd5818cc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:03.515717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d593090d-f703-4a05-86bf-6027bd5818cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:03.606403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9ccd20d4224d7f8e61f02e19a053bb'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.610681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9ccd20d4224d7f8e61f02e19a053bb'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.641137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593090d-f703-4a05-86bf-6027bd5818cc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:03.649659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341338b-0280-47c5-afe2-e3539f059141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:03.650597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9ccd20d4224d7f8e61f02e19a053bb'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.650719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341338b-0280-47c5-afe2-e3539f059141 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:03.651743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341338b-0280-47c5-afe2-e3539f059141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:03.652241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341338b-0280-47c5-afe2-e3539f059141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:03.655757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7341338b-0280-47c5-afe2-e3539f059141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:03.668144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9ccd20d4224d7f8e61f02e19a053bb'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.668919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9ccd20d4224d7f8e61f02e19a053bb'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:03.681436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341338b-0280-47c5-afe2-e3539f059141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:03.683821 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341338b-0280-47c5-afe2-e3539f059141 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:03.702428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 983/1986] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:03 2022] DELETE /identity/v3/users/af9ccd20d4224d7f8e61f02e19a053bb => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:03.703484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1004/1987] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:42:04.046402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:04.048099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:04.089843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:04.242813 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f02953-c8b4-4af6-b6ba-e7141b9ccb14 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:04.267066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:04.268010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:04.268282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:04.268563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] PATH_INFO: `/v3/projects/36423f5e5d00416290468afcca9ecfb4` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:04.272553 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36423f5e5d00416290468afcca9ecfb4)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:04.274529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:04.428176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36423f5e5d00416290468afcca9ecfb4', 'request_id': 'req-df93b361-0ea9-485e-bf81-61ae68f37048'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:04.443972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36423f5e5d00416290468afcca9ecfb4', 'request_id': 'req-df93b361-0ea9-485e-bf81-61ae68f37048'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:04.461656 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36423f5e5d00416290468afcca9ecfb4', 'request_id': 'req-df93b361-0ea9-485e-bf81-61ae68f37048'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:04.477046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] The token cache is being invalidate because project 36423f5e5d00416290468afcca9ecfb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:04.477046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:04.477927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-df93b361-0ea9-485e-bf81-61ae68f37048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:04.480563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 984/1988] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:04 2022] DELETE /identity/v3/projects/36423f5e5d00416290468afcca9ecfb4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:04.486175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9f1d1-483e-4e42-a2b7-e8af9a6431e2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:04.487759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9f1d1-483e-4e42-a2b7-e8af9a6431e2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:04.487759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9f1d1-483e-4e42-a2b7-e8af9a6431e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:04.529484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e2d9f1d1-483e-4e42-a2b7-e8af9a6431e2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:04.530830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e2d9f1d1-483e-4e42-a2b7-e8af9a6431e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:04.589165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:04.707839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1005/1989] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:04.711099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9e82-4e17-4fd9-8be5-be4bff9a768d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:04.711526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9e82-4e17-4fd9-8be5-be4bff9a768d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:04.712002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9e82-4e17-4fd9-8be5-be4bff9a768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:04.756052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f83b9e82-4e17-4fd9-8be5-be4bff9a768d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:04.760070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f83b9e82-4e17-4fd9-8be5-be4bff9a768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:04.782202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 985/1990] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:04.784088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9f1d1-483e-4e42-a2b7-e8af9a6431e2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:04.808378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9f1d1-483e-4e42-a2b7-e8af9a6431e2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:04.822905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50643a-0813-4ac6-b48e-3fb0e1c6d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:04.830157 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50643a-0813-4ac6-b48e-3fb0e1c6d0ca admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:04.830777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50643a-0813-4ac6-b48e-3fb0e1c6d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:04.831406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50643a-0813-4ac6-b48e-3fb0e1c6d0ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:04.832236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50643a-0813-4ac6-b48e-3fb0e1c6d0ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:42:04.832549 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50643a-0813-4ac6-b48e-3fb0e1c6d0ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:04.835414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9e82-4e17-4fd9-8be5-be4bff9a768d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:04.836435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50643a-0813-4ac6-b48e-3fb0e1c6d0ca admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:04.837749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f83b9e82-4e17-4fd9-8be5-be4bff9a768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:04.877811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1006/1991] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:42:04.879318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50643a-0813-4ac6-b48e-3fb0e1c6d0ca admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:04.888675 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9e82-4e17-4fd9-8be5-be4bff9a768d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:04.905861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:04.907424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:04.909724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:04.910479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] PATH_INFO: `/v3/projects/5de41e06c92d424e8f7e4cc94d0c0b3f` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:04.914177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de41e06c92d424e8f7e4cc94d0c0b3f)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:04.919925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:04.930625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50643a-0813-4ac6-b48e-3fb0e1c6d0ca admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:04.947296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed914e-90ea-4bc4-8e17-25083665a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:04.948637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed914e-90ea-4bc4-8e17-25083665a23e admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:04.949946 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed914e-90ea-4bc4-8e17-25083665a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:04.967415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed914e-90ea-4bc4-8e17-25083665a23e admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:04.967415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed914e-90ea-4bc4-8e17-25083665a23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:04.967415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed914e-90ea-4bc4-8e17-25083665a23e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:05.036338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1007/1992] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:04 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:05.043188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed914e-90ea-4bc4-8e17-25083665a23e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:05.109089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de41e06c92d424e8f7e4cc94d0c0b3f', 'request_id': 'req-991b5417-f060-42c2-8101-8b5a6ad03b53'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:05.133070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de41e06c92d424e8f7e4cc94d0c0b3f', 'request_id': 'req-991b5417-f060-42c2-8101-8b5a6ad03b53'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:05.155477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de41e06c92d424e8f7e4cc94d0c0b3f', 'request_id': 'req-991b5417-f060-42c2-8101-8b5a6ad03b53'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:05.202635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] The token cache is being invalidate because project 5de41e06c92d424e8f7e4cc94d0c0b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:05.203089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:05.204485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-991b5417-f060-42c2-8101-8b5a6ad03b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:05.207040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed914e-90ea-4bc4-8e17-25083665a23e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:05.207333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 986/1993] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:04 2022] DELETE /identity/v3/projects/5de41e06c92d424e8f7e4cc94d0c0b3f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:42:05.213498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b99574-0586-4a04-83da-3bf824298318 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:05.214130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b99574-0586-4a04-83da-3bf824298318 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:05.214625 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b99574-0586-4a04-83da-3bf824298318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:05.271389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-92b99574-0586-4a04-83da-3bf824298318 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:05.273712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-92b99574-0586-4a04-83da-3bf824298318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:05.345168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:05.407855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511a310-ada0-4360-9dd3-4c2abc4e3ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:05.408545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511a310-ada0-4360-9dd3-4c2abc4e3ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:05.408834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511a310-ada0-4360-9dd3-4c2abc4e3ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:05.409108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511a310-ada0-4360-9dd3-4c2abc4e3ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:05.409756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511a310-ada0-4360-9dd3-4c2abc4e3ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:05.414812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511a310-ada0-4360-9dd3-4c2abc4e3ae5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:05.485380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 987/1994] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:05.493364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903963a1-1c36-4539-a65c-989f3a822917 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:05.493364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903963a1-1c36-4539-a65c-989f3a822917 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:05.493364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903963a1-1c36-4539-a65c-989f3a822917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:05.547842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1008/1995] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:05 2022] POST /identity/v3/users => generated 293 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:05.554605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511a310-ada0-4360-9dd3-4c2abc4e3ae5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:05.560649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f511a310-ada0-4360-9dd3-4c2abc4e3ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:05.563887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-903963a1-1c36-4539-a65c-989f3a822917 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:05.568542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-903963a1-1c36-4539-a65c-989f3a822917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:05.582184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511a310-ada0-4360-9dd3-4c2abc4e3ae5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:05.589733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0a2a8-bb57-45e8-a99d-25cc5afd808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:05.593499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0a2a8-bb57-45e8-a99d-25cc5afd808f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:05.596264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0a2a8-bb57-45e8-a99d-25cc5afd808f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:05.597186 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 988/1996] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:42:05.597372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0a2a8-bb57-45e8-a99d-25cc5afd808f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:05.598505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0a2a8-bb57-45e8-a99d-25cc5afd808f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:05.602183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903963a1-1c36-4539-a65c-989f3a822917 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:05.609200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0a2a8-bb57-45e8-a99d-25cc5afd808f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:05.613003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903963a1-1c36-4539-a65c-989f3a822917 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:05.619215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddaa99-39b1-4cd7-996e-07add9e24358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:05.620406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddaa99-39b1-4cd7-996e-07add9e24358 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:05.620694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddaa99-39b1-4cd7-996e-07add9e24358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:05.620972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddaa99-39b1-4cd7-996e-07add9e24358 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:05.621671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddaa99-39b1-4cd7-996e-07add9e24358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:42:05.621980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddaa99-39b1-4cd7-996e-07add9e24358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:05.624092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddaa99-39b1-4cd7-996e-07add9e24358 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:05.646661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 989/1997] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:42:05.648440 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddaa99-39b1-4cd7-996e-07add9e24358 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:05.654005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1009/1998] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:05.656225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0a2a8-bb57-45e8-a99d-25cc5afd808f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:05.664140 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddaa99-39b1-4cd7-996e-07add9e24358 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:05.679399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d7986-ddda-4ce8-9631-f4939954f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:05.680157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d7986-ddda-4ce8-9631-f4939954f1bc admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:05.680517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d7986-ddda-4ce8-9631-f4939954f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:05.680869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d7986-ddda-4ce8-9631-f4939954f1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:05.681637 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d7986-ddda-4ce8-9631-f4939954f1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:05.685087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d7986-ddda-4ce8-9631-f4939954f1bc admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:05.716868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0a2a8-bb57-45e8-a99d-25cc5afd808f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:05.736138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c89dab-21b7-481f-a42c-8690b39c9162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:05.738433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c89dab-21b7-481f-a42c-8690b39c9162 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:05.740876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c89dab-21b7-481f-a42c-8690b39c9162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:05.742363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c89dab-21b7-481f-a42c-8690b39c9162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:05.746730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c89dab-21b7-481f-a42c-8690b39c9162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:05.759843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c89dab-21b7-481f-a42c-8690b39c9162 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:05.770407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 990/1999] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:05 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:05.774970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d7986-ddda-4ce8-9631-f4939954f1bc admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:05.804663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1010/2000] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:05.809027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c89dab-21b7-481f-a42c-8690b39c9162 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:05.853493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c89dab-21b7-481f-a42c-8690b39c9162 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:05.867923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:05.982114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d7986-ddda-4ce8-9631-f4939954f1bc admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:06.003223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf7275-9929-407d-930a-3edd936faff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:06.003956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf7275-9929-407d-930a-3edd936faff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.004269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf7275-9929-407d-930a-3edd936faff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.004712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf7275-9929-407d-930a-3edd936faff9 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.006907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf7275-9929-407d-930a-3edd936faff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:06.009009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf7275-9929-407d-930a-3edd936faff9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:06.042243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe51c3-5daf-4f76-afe8-ec02c7d0be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:06.043272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe51c3-5daf-4f76-afe8-ec02c7d0be2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.043705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe51c3-5daf-4f76-afe8-ec02c7d0be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.045038 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe51c3-5daf-4f76-afe8-ec02c7d0be2d admin admin] PATH_INFO: `/v3/projects/aef6b840b14d4407bd22d647d7616667/users/61356bb6488e44efad8566ea381d4d5d/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.049706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 991/2001] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:05 2022] POST /identity/v3/users => generated 282 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:06.056889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf7275-9929-407d-930a-3edd936faff9 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:06.072099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf7275-9929-407d-930a-3edd936faff9 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:06.081000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624aa9-bde6-445d-af5c-a18b6cf55b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:06.081944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624aa9-bde6-445d-af5c-a18b6cf55b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.082356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624aa9-bde6-445d-af5c-a18b6cf55b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.082705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624aa9-bde6-445d-af5c-a18b6cf55b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.084213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89624aa9-bde6-445d-af5c-a18b6cf55b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:06.089054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89624aa9-bde6-445d-af5c-a18b6cf55b07 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:06.115030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 992/2002] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:42:06.118082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624aa9-bde6-445d-af5c-a18b6cf55b07 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:06.125263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe51c3-5daf-4f76-afe8-ec02c7d0be2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef6b840b14d4407bd22d647d7616667, user_id=61356bb6488e44efad8566ea381d4d5d, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:06.130862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe51c3-5daf-4f76-afe8-ec02c7d0be2d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:06.142845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624aa9-bde6-445d-af5c-a18b6cf55b07 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:06.161605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1011/2003] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:05 2022] PUT /identity/v3/projects/aef6b840b14d4407bd22d647d7616667/users/61356bb6488e44efad8566ea381d4d5d/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:06.173610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b913b-790b-49f8-889d-fb304d0ce4d0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.175989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b913b-790b-49f8-889d-fb304d0ce4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.176478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b913b-790b-49f8-889d-fb304d0ce4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.239801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-402b913b-790b-49f8-889d-fb304d0ce4d0 None None] MFA Rules not processed for user `61356bb6488e44efad8566ea381d4d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:06.241616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-402b913b-790b-49f8-889d-fb304d0ce4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:06.357561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dd5bd-44c1-415a-9f7c-4203bead596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:06.360501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dd5bd-44c1-415a-9f7c-4203bead596d admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.360816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dd5bd-44c1-415a-9f7c-4203bead596d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.362795 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dd5bd-44c1-415a-9f7c-4203bead596d admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.364896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dd5bd-44c1-415a-9f7c-4203bead596d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:06.371088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dd5bd-44c1-415a-9f7c-4203bead596d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:06.374300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:06.418361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 993/2004] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:06.421838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dd5bd-44c1-415a-9f7c-4203bead596d admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:06.450377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dd5bd-44c1-415a-9f7c-4203bead596d admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:06.464239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b83574-ead3-4fd4-a084-719479f6e3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:06.467266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b83574-ead3-4fd4-a084-719479f6e3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.467565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b83574-ead3-4fd4-a084-719479f6e3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.467826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b83574-ead3-4fd4-a084-719479f6e3a7 admin admin] PATH_INFO: `/v3/projects/db8e3f97240c4d20b16075c54242bc1d/users/6892eb88523b44efade9f6d8cc3eb733/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.468647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1012/2005] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:06.471044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b913b-790b-49f8-889d-fb304d0ce4d0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:06.501842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b913b-790b-49f8-889d-fb304d0ce4d0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:06.507835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b83574-ead3-4fd4-a084-719479f6e3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8e3f97240c4d20b16075c54242bc1d, user_id=6892eb88523b44efade9f6d8cc3eb733, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:06.514129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4240-5ff7-4d6b-9f23-678d9e52e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:06.514838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4240-5ff7-4d6b-9f23-678d9e52e805 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.515156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4240-5ff7-4d6b-9f23-678d9e52e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.515524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b4240-5ff7-4d6b-9f23-678d9e52e805 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.516317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4240-5ff7-4d6b-9f23-678d9e52e805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:06.519026 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b83574-ead3-4fd4-a084-719479f6e3a7 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:06.522116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b4240-5ff7-4d6b-9f23-678d9e52e805 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:06.564742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 994/2006] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:06 2022] PUT /identity/v3/projects/db8e3f97240c4d20b16075c54242bc1d/users/6892eb88523b44efade9f6d8cc3eb733/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:06.576620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37684733-557c-4ac8-b754-a43fea9580aa None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.576972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37684733-557c-4ac8-b754-a43fea9580aa None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.578509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37684733-557c-4ac8-b754-a43fea9580aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.634962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1013/2007] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:06 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:06.641129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4240-5ff7-4d6b-9f23-678d9e52e805 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:06.684156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-37684733-557c-4ac8-b754-a43fea9580aa None None] MFA Rules not processed for user `6892eb88523b44efade9f6d8cc3eb733`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:06.687835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-37684733-557c-4ac8-b754-a43fea9580aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:06.790483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:06.798776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b4240-5ff7-4d6b-9f23-678d9e52e805 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:06.815967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41724266-a4cc-475b-be2a-8e96ac9b95e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:06.816593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41724266-a4cc-475b-be2a-8e96ac9b95e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.816878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41724266-a4cc-475b-be2a-8e96ac9b95e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.817160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41724266-a4cc-475b-be2a-8e96ac9b95e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.818112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41724266-a4cc-475b-be2a-8e96ac9b95e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:06.820122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41724266-a4cc-475b-be2a-8e96ac9b95e4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:06.852755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 995/2008] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:06.854264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37684733-557c-4ac8-b754-a43fea9580aa None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:06.870475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1014/2009] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:06 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:42:06.875136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41724266-a4cc-475b-be2a-8e96ac9b95e4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:06.881816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37684733-557c-4ac8-b754-a43fea9580aa None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:06.895926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41724266-a4cc-475b-be2a-8e96ac9b95e4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:06.899293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9475a-d04b-4559-99d8-b1fcaabd0583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:06.899930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9475a-d04b-4559-99d8-b1fcaabd0583 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.900606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9475a-d04b-4559-99d8-b1fcaabd0583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.900899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9475a-d04b-4559-99d8-b1fcaabd0583 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.902250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9475a-d04b-4559-99d8-b1fcaabd0583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:06.906188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9475a-d04b-4559-99d8-b1fcaabd0583 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:06.915300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f8c3-3f3d-477d-af15-d6e167c3c7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:06.916048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f8c3-3f3d-477d-af15-d6e167c3c7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:06.916329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f8c3-3f3d-477d-af15-d6e167c3c7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:06.916690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f8c3-3f3d-477d-af15-d6e167c3c7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:06.920163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39f8c3-3f3d-477d-af15-d6e167c3c7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:06.921906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39f8c3-3f3d-477d-af15-d6e167c3c7b0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:06.941538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1015/2010] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:42:06.945244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f8c3-3f3d-477d-af15-d6e167c3c7b0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:06.968885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 996/2011] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:06 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:06.970073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9475a-d04b-4559-99d8-b1fcaabd0583 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:06.978415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f8c3-3f3d-477d-af15-d6e167c3c7b0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:07.085010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9475a-d04b-4559-99d8-b1fcaabd0583 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:07.092358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b2450-7e55-4fa6-989d-46c44b999f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:07.092981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b2450-7e55-4fa6-989d-46c44b999f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.093265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b2450-7e55-4fa6-989d-46c44b999f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.093936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b2450-7e55-4fa6-989d-46c44b999f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:07.094278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b2450-7e55-4fa6-989d-46c44b999f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:07.096264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b2450-7e55-4fa6-989d-46c44b999f37 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:07.117919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592261d-a7ca-42bd-98c9-af3ac7a269bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:07.118619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592261d-a7ca-42bd-98c9-af3ac7a269bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.118909 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592261d-a7ca-42bd-98c9-af3ac7a269bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.119202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592261d-a7ca-42bd-98c9-af3ac7a269bc admin admin] PATH_INFO: `/v3/projects/fa735cb4643648cd9ddb51b20107886f/users/55290f0f0a0e44c3adf7bfac90377138/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:07.131838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 997/2012] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:06 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:07.135743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b2450-7e55-4fa6-989d-46c44b999f37 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:07.150723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b2450-7e55-4fa6-989d-46c44b999f37 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:07.157735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592261d-a7ca-42bd-98c9-af3ac7a269bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa735cb4643648cd9ddb51b20107886f, user_id=55290f0f0a0e44c3adf7bfac90377138, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:07.160601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592261d-a7ca-42bd-98c9-af3ac7a269bc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:07.184300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e26a28-ba84-4a65-975c-2134a66cc05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:07.185551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26a28-ba84-4a65-975c-2134a66cc05a admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.186067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26a28-ba84-4a65-975c-2134a66cc05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.186574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26a28-ba84-4a65-975c-2134a66cc05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:07.188016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e26a28-ba84-4a65-975c-2134a66cc05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:07.189651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1016/2013] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:06 2022] PUT /identity/v3/projects/fa735cb4643648cd9ddb51b20107886f/users/55290f0f0a0e44c3adf7bfac90377138/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:07.191684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e26a28-ba84-4a65-975c-2134a66cc05a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:07.193641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592261d-a7ca-42bd-98c9-af3ac7a269bc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:07.232023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 998/2014] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:42:07.237323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e26a28-ba84-4a65-975c-2134a66cc05a admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:07.251096 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e26a28-ba84-4a65-975c-2134a66cc05a admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:07.280534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:07.360803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592261d-a7ca-42bd-98c9-af3ac7a269bc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:07.379515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c56b9-c6b8-47a6-8a4c-acc3434c5d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:07.380201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c56b9-c6b8-47a6-8a4c-acc3434c5d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.380586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c56b9-c6b8-47a6-8a4c-acc3434c5d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.381070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c56b9-c6b8-47a6-8a4c-acc3434c5d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:07.381790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c56b9-c6b8-47a6-8a4c-acc3434c5d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:07.386141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c56b9-c6b8-47a6-8a4c-acc3434c5d42 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:07.415386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1017/2015] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:07.415386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c56b9-c6b8-47a6-8a4c-acc3434c5d42 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:07.465565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e562ad-8c1d-4fe2-a69f-53b6e7a13926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:07.465792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c56b9-c6b8-47a6-8a4c-acc3434c5d42 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:07.465891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e562ad-8c1d-4fe2-a69f-53b6e7a13926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.466379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e562ad-8c1d-4fe2-a69f-53b6e7a13926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.468917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e562ad-8c1d-4fe2-a69f-53b6e7a13926 admin admin] PATH_INFO: `/v3/projects/b4a4ed4427244d86a728d18847b3e8de/users/e5875b45bc9f4b729e1454573cfd19f2/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:07.477660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534057d3-6fec-4e21-8f10-a3529dcf49ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:07.480589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534057d3-6fec-4e21-8f10-a3529dcf49ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.481907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534057d3-6fec-4e21-8f10-a3529dcf49ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.482364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534057d3-6fec-4e21-8f10-a3529dcf49ac admin admin] PATH_INFO: `/v3/projects/fa735cb4643648cd9ddb51b20107886f/users/55290f0f0a0e44c3adf7bfac90377138/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:07.488919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534057d3-6fec-4e21-8f10-a3529dcf49ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa735cb4643648cd9ddb51b20107886f, user_id=55290f0f0a0e44c3adf7bfac90377138, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:07.493667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534057d3-6fec-4e21-8f10-a3529dcf49ac admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:07.519748 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e562ad-8c1d-4fe2-a69f-53b6e7a13926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a4ed4427244d86a728d18847b3e8de, user_id=e5875b45bc9f4b729e1454573cfd19f2, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:07.524343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e562ad-8c1d-4fe2-a69f-53b6e7a13926 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:07.549367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1018/2016] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:07 2022] PUT /identity/v3/projects/fa735cb4643648cd9ddb51b20107886f/users/55290f0f0a0e44c3adf7bfac90377138/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:07.568187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ad6fb-9583-43f0-9d6a-8302f7d49106 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.572932 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ad6fb-9583-43f0-9d6a-8302f7d49106 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.573550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ad6fb-9583-43f0-9d6a-8302f7d49106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:07.597629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 999/2017] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:07 2022] PUT /identity/v3/projects/b4a4ed4427244d86a728d18847b3e8de/users/e5875b45bc9f4b729e1454573cfd19f2/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:07.599855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e562ad-8c1d-4fe2-a69f-53b6e7a13926 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:07.707591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a61ad6fb-9583-43f0-9d6a-8302f7d49106 None None] MFA Rules not processed for user `55290f0f0a0e44c3adf7bfac90377138`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:07.709117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a61ad6fb-9583-43f0-9d6a-8302f7d49106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:07.759032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:07.787873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e562ad-8c1d-4fe2-a69f-53b6e7a13926 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:07.811120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d88b0c-60c8-4fd7-9ded-c40a0085e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:07.811922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88b0c-60c8-4fd7-9ded-c40a0085e39f admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.812305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88b0c-60c8-4fd7-9ded-c40a0085e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.812678 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88b0c-60c8-4fd7-9ded-c40a0085e39f admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:07.813468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d88b0c-60c8-4fd7-9ded-c40a0085e39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:07.815664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d88b0c-60c8-4fd7-9ded-c40a0085e39f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:07.842998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1000/2018] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:07.846142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d88b0c-60c8-4fd7-9ded-c40a0085e39f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:07.866910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d88b0c-60c8-4fd7-9ded-c40a0085e39f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:07.889515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d2329-5604-480c-80df-8b2a82fa0a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:07.890630 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d2329-5604-480c-80df-8b2a82fa0a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.891149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d2329-5604-480c-80df-8b2a82fa0a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.891710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d2329-5604-480c-80df-8b2a82fa0a80 admin admin] PATH_INFO: `/v3/projects/b4a4ed4427244d86a728d18847b3e8de/users/e5875b45bc9f4b729e1454573cfd19f2/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:07.900415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d2329-5604-480c-80df-8b2a82fa0a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a4ed4427244d86a728d18847b3e8de, user_id=e5875b45bc9f4b729e1454573cfd19f2, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:07.912927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d2329-5604-480c-80df-8b2a82fa0a80 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:07.945984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1019/2019] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:07.953730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ad6fb-9583-43f0-9d6a-8302f7d49106 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:07.957495 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a61ad6fb-9583-43f0-9d6a-8302f7d49106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:07.959393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1001/2020] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:07 2022] PUT /identity/v3/projects/b4a4ed4427244d86a728d18847b3e8de/users/e5875b45bc9f4b729e1454573cfd19f2/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:42:07.960978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac8f09-50dc-4713-90c5-bec33aecc649 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:07.961386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac8f09-50dc-4713-90c5-bec33aecc649 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:07.961771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac8f09-50dc-4713-90c5-bec33aecc649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:08.029200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5bac8f09-50dc-4713-90c5-bec33aecc649 None None] MFA Rules not processed for user `e5875b45bc9f4b729e1454573cfd19f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:08.030588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5bac8f09-50dc-4713-90c5-bec33aecc649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:08.089304 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ad6fb-9583-43f0-9d6a-8302f7d49106 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:08.172545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1002/2021] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:08.183658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514467b2-6dde-4c16-bb50-b8b48e0d8632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:08.184310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514467b2-6dde-4c16-bb50-b8b48e0d8632 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:08.184594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514467b2-6dde-4c16-bb50-b8b48e0d8632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:08.184870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514467b2-6dde-4c16-bb50-b8b48e0d8632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:08.189514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac8f09-50dc-4713-90c5-bec33aecc649 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:08.190978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5bac8f09-50dc-4713-90c5-bec33aecc649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:08.221807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac8f09-50dc-4713-90c5-bec33aecc649 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:08.242857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569777-66be-4b2a-95aa-176becbf4d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:08.245010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569777-66be-4b2a-95aa-176becbf4d83 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:08.245449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569777-66be-4b2a-95aa-176becbf4d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:08.245784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569777-66be-4b2a-95aa-176becbf4d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:08.274032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569777-66be-4b2a-95aa-176becbf4d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:08.275572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569777-66be-4b2a-95aa-176becbf4d83 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:08.292374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:08.322461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1003/2022] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:42:08.396499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514467b2-6dde-4c16-bb50-b8b48e0d8632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:08.398710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514467b2-6dde-4c16-bb50-b8b48e0d8632 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:08.471114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1020/2023] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:09.451473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569777-66be-4b2a-95aa-176becbf4d83 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:09.575931 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569777-66be-4b2a-95aa-176becbf4d83 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:09.584847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:09.588410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:09.589414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:09.589776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] PATH_INFO: `/v3/users/6892eb88523b44efade9f6d8cc3eb733` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:09.591289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6892eb88523b44efade9f6d8cc3eb733)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:09.593649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:09.672407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6892eb88523b44efade9f6d8cc3eb733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:09.673451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6892eb88523b44efade9f6d8cc3eb733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:09.694739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6892eb88523b44efade9f6d8cc3eb733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:09.711003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6892eb88523b44efade9f6d8cc3eb733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:09.711003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6892eb88523b44efade9f6d8cc3eb733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:09.730866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1004/2024] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:09 2022] DELETE /identity/v3/users/6892eb88523b44efade9f6d8cc3eb733 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:09.745043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a18d6-7e24-470f-9cd6-abfcb90c15bc None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:09.745582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a18d6-7e24-470f-9cd6-abfcb90c15bc None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:09.748397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a18d6-7e24-470f-9cd6-abfcb90c15bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:09.774677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-882a18d6-7e24-470f-9cd6-abfcb90c15bc None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:09.777260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-882a18d6-7e24-470f-9cd6-abfcb90c15bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:09.888817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:09.978321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1021/2025] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:09.999337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:10.001096 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:10.209036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9599ef-20d7-44a2-8040-6621d0b8f67d admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:10.215644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfdb03-8855-4b87-b8b3-5d13b2e6aa00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:10.216183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfdb03-8855-4b87-b8b3-5d13b2e6aa00 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:10.216476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfdb03-8855-4b87-b8b3-5d13b2e6aa00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:10.216762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfdb03-8855-4b87-b8b3-5d13b2e6aa00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:10.246673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfdb03-8855-4b87-b8b3-5d13b2e6aa00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:10.248753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cfdb03-8855-4b87-b8b3-5d13b2e6aa00 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:10.261927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1005/2026] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:11.247044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a18d6-7e24-470f-9cd6-abfcb90c15bc None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:11.249300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-882a18d6-7e24-470f-9cd6-abfcb90c15bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:11.280050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a18d6-7e24-470f-9cd6-abfcb90c15bc None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:11.286570 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:11.287518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:11.288003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:11.288469 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] PATH_INFO: `/v3/projects/db8e3f97240c4d20b16075c54242bc1d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:11.292569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8e3f97240c4d20b16075c54242bc1d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:11.296547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:11.368340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8e3f97240c4d20b16075c54242bc1d', 'request_id': 'req-144c16c0-cd15-46b7-af82-dc23a06d1428'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.376349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8e3f97240c4d20b16075c54242bc1d', 'request_id': 'req-144c16c0-cd15-46b7-af82-dc23a06d1428'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.389585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8e3f97240c4d20b16075c54242bc1d', 'request_id': 'req-144c16c0-cd15-46b7-af82-dc23a06d1428'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.405380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] The token cache is being invalidate because project db8e3f97240c4d20b16075c54242bc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:11.405688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.406393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-144c16c0-cd15-46b7-af82-dc23a06d1428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.408690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1022/2027] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:11 2022] DELETE /identity/v3/projects/db8e3f97240c4d20b16075c54242bc1d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:11.412833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfdb03-8855-4b87-b8b3-5d13b2e6aa00 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:11.443811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfdb03-8855-4b87-b8b3-5d13b2e6aa00 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:11.486031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:11.587187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:11.592240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:11.592740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:11.593211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] PATH_INFO: `/v3/users/e5875b45bc9f4b729e1454573cfd19f2` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:11.597500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5875b45bc9f4b729e1454573cfd19f2)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:11.602901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:11.676300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5875b45bc9f4b729e1454573cfd19f2'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.677332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5875b45bc9f4b729e1454573cfd19f2'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.704885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5875b45bc9f4b729e1454573cfd19f2'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.714832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5875b45bc9f4b729e1454573cfd19f2'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.716190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5875b45bc9f4b729e1454573cfd19f2'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:11.738499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1006/2028] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:11 2022] DELETE /identity/v3/users/e5875b45bc9f4b729e1454573cfd19f2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:11.808429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00095c-2bb8-4e95-8fb7-a0fd5378bff7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:11.808715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00095c-2bb8-4e95-8fb7-a0fd5378bff7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:11.809789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00095c-2bb8-4e95-8fb7-a0fd5378bff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:11.882516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5b00095c-2bb8-4e95-8fb7-a0fd5378bff7 None None] MFA Rules not processed for user `e1fef50560dc4be8a3fc95129e4a2c41`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:11.889155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5b00095c-2bb8-4e95-8fb7-a0fd5378bff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:12.069493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1023/2029] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:12.103068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:12.106705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:12.306049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00095c-2bb8-4e95-8fb7-a0fd5378bff7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:12.313458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5b00095c-2bb8-4e95-8fb7-a0fd5378bff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:12.430775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6e28d-9624-490d-a309-c4e7afaef178 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:12.444406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c3ddd-874d-4cde-b5b1-fdfb6ffd5037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:12.446479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c3ddd-874d-4cde-b5b1-fdfb6ffd5037 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:12.447982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c3ddd-874d-4cde-b5b1-fdfb6ffd5037 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:12.449275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c3ddd-874d-4cde-b5b1-fdfb6ffd5037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:12.453055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-fb9c3ddd-874d-4cde-b5b1-fdfb6ffd5037 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:12.486550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:12.528370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00095c-2bb8-4e95-8fb7-a0fd5378bff7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:12.531651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:12.540589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:12.542101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:12.542790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:12.543528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] PATH_INFO: `/v3/projects/b4a4ed4427244d86a728d18847b3e8de` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:12.545354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a4ed4427244d86a728d18847b3e8de)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:12.548043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:12.599262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c3ddd-874d-4cde-b5b1-fdfb6ffd5037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:12.600919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c3ddd-874d-4cde-b5b1-fdfb6ffd5037 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:12.628313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1007/2030] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:12.656988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a4ed4427244d86a728d18847b3e8de', 'request_id': 'req-8393b142-a4df-48ec-9e9a-3f84d830158a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.665631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a4ed4427244d86a728d18847b3e8de', 'request_id': 'req-8393b142-a4df-48ec-9e9a-3f84d830158a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.679526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a4ed4427244d86a728d18847b3e8de', 'request_id': 'req-8393b142-a4df-48ec-9e9a-3f84d830158a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.699250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] The token cache is being invalidate because project b4a4ed4427244d86a728d18847b3e8de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:12.699250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.700129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8393b142-a4df-48ec-9e9a-3f84d830158a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:12.702332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1024/2031] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:12 2022] DELETE /identity/v3/projects/b4a4ed4427244d86a728d18847b3e8de => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:42:12.707581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4a72a-4d6d-4c81-975e-c57a4b469a5c None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:12.708223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4a72a-4d6d-4c81-975e-c57a4b469a5c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:12.708681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4a72a-4d6d-4c81-975e-c57a4b469a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:12.736354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8db4a72a-4d6d-4c81-975e-c57a4b469a5c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:12.737461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8db4a72a-4d6d-4c81-975e-c57a4b469a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:12.859809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1008/2032] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:12.861617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d41f2-01a0-49cc-83f8-bedf2657351e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:12.862579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d41f2-01a0-49cc-83f8-bedf2657351e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:12.863060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d41f2-01a0-49cc-83f8-bedf2657351e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:12.911692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f61d41f2-01a0-49cc-83f8-bedf2657351e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:12.913070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f61d41f2-01a0-49cc-83f8-bedf2657351e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:12.934386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1025/2033] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:12.939015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4a72a-4d6d-4c81-975e-c57a4b469a5c None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:13.014762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4a72a-4d6d-4c81-975e-c57a4b469a5c None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:13.020598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72272c-65fa-48fb-a384-b5ea76cf0c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:13.023676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72272c-65fa-48fb-a384-b5ea76cf0c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:13.023949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72272c-65fa-48fb-a384-b5ea76cf0c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:13.038344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72272c-65fa-48fb-a384-b5ea76cf0c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:13.039188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72272c-65fa-48fb-a384-b5ea76cf0c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:42:13.039516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72272c-65fa-48fb-a384-b5ea76cf0c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:13.042661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72272c-65fa-48fb-a384-b5ea76cf0c40 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:13.081963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1009/2034] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:42:13.087101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d41f2-01a0-49cc-83f8-bedf2657351e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:13.097651 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d41f2-01a0-49cc-83f8-bedf2657351e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:13.121609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44dba0-81f2-4798-992c-4d2f4d35a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:13.122554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44dba0-81f2-4798-992c-4d2f4d35a1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:13.125800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44dba0-81f2-4798-992c-4d2f4d35a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:13.132270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44dba0-81f2-4798-992c-4d2f4d35a1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:13.139254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44dba0-81f2-4798-992c-4d2f4d35a1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:13.146659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44dba0-81f2-4798-992c-4d2f4d35a1e0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:13.266700 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1026/2035] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:13 2022] POST /identity/v3/projects => generated 355 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:13.271435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72272c-65fa-48fb-a384-b5ea76cf0c40 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:13.287361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72272c-65fa-48fb-a384-b5ea76cf0c40 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:13.393294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6e679-b9ee-4a0e-8c6f-88877c87f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:13.394116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6e679-b9ee-4a0e-8c6f-88877c87f8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:13.394873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6e679-b9ee-4a0e-8c6f-88877c87f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:13.395929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6e679-b9ee-4a0e-8c6f-88877c87f8d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:13.396529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6e679-b9ee-4a0e-8c6f-88877c87f8d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:13.400287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6e679-b9ee-4a0e-8c6f-88877c87f8d8 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:13.438994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1010/2036] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:13 2022] POST /identity/v3/users => generated 278 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:13.448754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44dba0-81f2-4798-992c-4d2f4d35a1e0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:13.472947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44dba0-81f2-4798-992c-4d2f4d35a1e0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:13.478169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc674b9d-a881-4614-9e61-540d2cc13edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:13.479186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc674b9d-a881-4614-9e61-540d2cc13edb admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:13.480148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc674b9d-a881-4614-9e61-540d2cc13edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:13.480575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc674b9d-a881-4614-9e61-540d2cc13edb admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:13.481429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc674b9d-a881-4614-9e61-540d2cc13edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:13.483346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc674b9d-a881-4614-9e61-540d2cc13edb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:13.502484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1027/2037] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:13.508640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6e679-b9ee-4a0e-8c6f-88877c87f8d8 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:13.527973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6e679-b9ee-4a0e-8c6f-88877c87f8d8 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:13.535838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f53b4c-2aaf-4666-a181-f810c6e568df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:13.536962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f53b4c-2aaf-4666-a181-f810c6e568df admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:13.537436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f53b4c-2aaf-4666-a181-f810c6e568df admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:13.537897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f53b4c-2aaf-4666-a181-f810c6e568df admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:13.538772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f53b4c-2aaf-4666-a181-f810c6e568df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:13.540891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f53b4c-2aaf-4666-a181-f810c6e568df admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:13.556758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1011/2038] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:13.558174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc674b9d-a881-4614-9e61-540d2cc13edb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:13.583506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc674b9d-a881-4614-9e61-540d2cc13edb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:13.596131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0236c-aace-4c47-a28b-c76c1697fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:13.596918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0236c-aace-4c47-a28b-c76c1697fa92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:13.597318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0236c-aace-4c47-a28b-c76c1697fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:13.597613 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0236c-aace-4c47-a28b-c76c1697fa92 admin admin] PATH_INFO: `/v3/projects/d26b0d6df65b40db941130a969eaff3a/users/f439f6bef139419db7007d369f010940/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:13.637534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0236c-aace-4c47-a28b-c76c1697fa92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26b0d6df65b40db941130a969eaff3a, user_id=f439f6bef139419db7007d369f010940, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:13.641553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0236c-aace-4c47-a28b-c76c1697fa92 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:13.676538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1028/2039] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:13 2022] PUT /identity/v3/projects/d26b0d6df65b40db941130a969eaff3a/users/f439f6bef139419db7007d369f010940/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:42:13.689137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d12cf-80aa-41b7-b638-75bd769be230 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:13.689875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d12cf-80aa-41b7-b638-75bd769be230 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:13.690227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d12cf-80aa-41b7-b638-75bd769be230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:13.758816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c40d12cf-80aa-41b7-b638-75bd769be230 None None] MFA Rules not processed for user `f439f6bef139419db7007d369f010940`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:13.760949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c40d12cf-80aa-41b7-b638-75bd769be230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:13.849466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:13.969512 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1012/2040] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:42:13.973875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0236c-aace-4c47-a28b-c76c1697fa92 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:14.192709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0236c-aace-4c47-a28b-c76c1697fa92 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:14.223121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816ffd-4ae5-42d7-bf53-4a0ee5b59116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:14.223751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816ffd-4ae5-42d7-bf53-4a0ee5b59116 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:14.224032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816ffd-4ae5-42d7-bf53-4a0ee5b59116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:14.224301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816ffd-4ae5-42d7-bf53-4a0ee5b59116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:14.225002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816ffd-4ae5-42d7-bf53-4a0ee5b59116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:14.227367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816ffd-4ae5-42d7-bf53-4a0ee5b59116 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:14.295794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:14.303159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d12cf-80aa-41b7-b638-75bd769be230 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:14.307696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c40d12cf-80aa-41b7-b638-75bd769be230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:14.328226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1029/2041] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:13 2022] POST /identity/v3/projects => generated 353 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:42:14.333463 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816ffd-4ae5-42d7-bf53-4a0ee5b59116 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:14.457780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816ffd-4ae5-42d7-bf53-4a0ee5b59116 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:14.468499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bdecc-6c14-4ddc-ae5c-4dd0054f878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:14.469506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bdecc-6c14-4ddc-ae5c-4dd0054f878d admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:14.469766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bdecc-6c14-4ddc-ae5c-4dd0054f878d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:14.470355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bdecc-6c14-4ddc-ae5c-4dd0054f878d admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:14.471404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bdecc-6c14-4ddc-ae5c-4dd0054f878d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:14.473840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bdecc-6c14-4ddc-ae5c-4dd0054f878d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:14.483062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d12cf-80aa-41b7-b638-75bd769be230 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:14.508674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1030/2042] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:14 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:14.515868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bdecc-6c14-4ddc-ae5c-4dd0054f878d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:14.535845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bdecc-6c14-4ddc-ae5c-4dd0054f878d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:14.543620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a11df-b1d6-401b-a097-d7a333fe519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:14.544232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a11df-b1d6-401b-a097-d7a333fe519d admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:14.544725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a11df-b1d6-401b-a097-d7a333fe519d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:14.545001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a11df-b1d6-401b-a097-d7a333fe519d admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:14.545730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a11df-b1d6-401b-a097-d7a333fe519d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:14.547785 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a11df-b1d6-401b-a097-d7a333fe519d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:14.561258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1031/2043] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:42:14.568838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a11df-b1d6-401b-a097-d7a333fe519d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:14.584477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a11df-b1d6-401b-a097-d7a333fe519d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:14.590629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bf9d9-e496-46fb-9e7c-d577877b7782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:14.591105 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae4b6-125f-47ac-90ea-6794cf87b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:14.591775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae4b6-125f-47ac-90ea-6794cf87b2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:14.592053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae4b6-125f-47ac-90ea-6794cf87b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:14.592323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ae4b6-125f-47ac-90ea-6794cf87b2dc admin admin] PATH_INFO: `/v3/projects/b81c4ac5e83543ecb8d3827a7735bec9/users/d690073fcf66479f90259e5e67a48123/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:14.592538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf9d9-e496-46fb-9e7c-d577877b7782 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:14.593170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf9d9-e496-46fb-9e7c-d577877b7782 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:14.593749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf9d9-e496-46fb-9e7c-d577877b7782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:14.596845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-579bf9d9-e496-46fb-9e7c-d577877b7782 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:14.609670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae4b6-125f-47ac-90ea-6794cf87b2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81c4ac5e83543ecb8d3827a7735bec9, user_id=d690073fcf66479f90259e5e67a48123, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:14.612580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ae4b6-125f-47ac-90ea-6794cf87b2dc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:14.632999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1032/2044] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:14 2022] PUT /identity/v3/projects/b81c4ac5e83543ecb8d3827a7735bec9/users/d690073fcf66479f90259e5e67a48123/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:42:14.639031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae4b6-125f-47ac-90ea-6794cf87b2dc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:14.735080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bf9d9-e496-46fb-9e7c-d577877b7782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:14.737206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bf9d9-e496-46fb-9e7c-d577877b7782 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:14.740793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ae4b6-125f-47ac-90ea-6794cf87b2dc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:14.747433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401d29c-4ebe-48ff-b996-6bc6b0d637da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:14.748279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401d29c-4ebe-48ff-b996-6bc6b0d637da admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:14.748658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401d29c-4ebe-48ff-b996-6bc6b0d637da admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:14.749031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401d29c-4ebe-48ff-b996-6bc6b0d637da admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:14.749847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401d29c-4ebe-48ff-b996-6bc6b0d637da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:14.751723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401d29c-4ebe-48ff-b996-6bc6b0d637da admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:14.754449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1013/2045] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:14.756662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea44fe-c094-49d2-9148-b6c75021a6f7 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:14.757139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea44fe-c094-49d2-9148-b6c75021a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:14.757581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea44fe-c094-49d2-9148-b6c75021a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:14.764415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1033/2046] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:14.770075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401d29c-4ebe-48ff-b996-6bc6b0d637da admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:14.786863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-3dea44fe-c094-49d2-9148-b6c75021a6f7 None None] MFA Rules not processed for user `3226b4c9f79c48ff9574c2af20a41a73`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:14.787952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401d29c-4ebe-48ff-b996-6bc6b0d637da admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:14.788645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3dea44fe-c094-49d2-9148-b6c75021a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:14.802632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513d451-3bff-4063-9fe5-0d654fb6c3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:14.804066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d451-3bff-4063-9fe5-0d654fb6c3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:14.804886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d451-3bff-4063-9fe5-0d654fb6c3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:14.804886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d451-3bff-4063-9fe5-0d654fb6c3bc admin admin] PATH_INFO: `/v3/projects/b81c4ac5e83543ecb8d3827a7735bec9/users/d690073fcf66479f90259e5e67a48123/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:14.808581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513d451-3bff-4063-9fe5-0d654fb6c3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81c4ac5e83543ecb8d3827a7735bec9, user_id=d690073fcf66479f90259e5e67a48123, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:14.812592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513d451-3bff-4063-9fe5-0d654fb6c3bc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:14.827163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1034/2047] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:14 2022] PUT /identity/v3/projects/b81c4ac5e83543ecb8d3827a7735bec9/users/d690073fcf66479f90259e5e67a48123/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:42:14.837717 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:14.840324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6a21a-9f06-4d95-969a-01b549c313ca None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:14.841121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6a21a-9f06-4d95-969a-01b549c313ca None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:14.841840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6a21a-9f06-4d95-969a-01b549c313ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:14.858355 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1014/2048] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:14.896639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f4b6a21a-9f06-4d95-969a-01b549c313ca None None] MFA Rules not processed for user `d690073fcf66479f90259e5e67a48123`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:14.898877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f4b6a21a-9f06-4d95-969a-01b549c313ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:14.938827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:15.007004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1035/2049] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:15.086725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea44fe-c094-49d2-9148-b6c75021a6f7 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:15.169558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea44fe-c094-49d2-9148-b6c75021a6f7 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:15.247567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d2cb1-72ce-484f-b2e0-9daae45f2433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:15.248344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d2cb1-72ce-484f-b2e0-9daae45f2433 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:15.248769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d2cb1-72ce-484f-b2e0-9daae45f2433 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:15.249169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d2cb1-72ce-484f-b2e0-9daae45f2433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:15.261504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d2cb1-72ce-484f-b2e0-9daae45f2433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:15.264151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d2cb1-72ce-484f-b2e0-9daae45f2433 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:15.287106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1015/2050] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:15 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:15.445178 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6a21a-9f06-4d95-969a-01b549c313ca None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:15.459941 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6a21a-9f06-4d95-969a-01b549c313ca None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:15.466458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b136b-8462-4020-9954-b2a44d11b63c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:15.467331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b136b-8462-4020-9954-b2a44d11b63c service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:15.467834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b136b-8462-4020-9954-b2a44d11b63c service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:15.468181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b136b-8462-4020-9954-b2a44d11b63c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:15.581910 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b136b-8462-4020-9954-b2a44d11b63c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:15.583935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b136b-8462-4020-9954-b2a44d11b63c service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:15.611525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1036/2051] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:20.519727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d2cb1-72ce-484f-b2e0-9daae45f2433 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:20.521192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-801d2cb1-72ce-484f-b2e0-9daae45f2433 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:20.593993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d2cb1-72ce-484f-b2e0-9daae45f2433 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:20.601854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:20.602692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:20.603022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:20.603385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] PATH_INFO: `/v3/users/61356bb6488e44efad8566ea381d4d5d` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:20.604929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=61356bb6488e44efad8566ea381d4d5d)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:20.607303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:20.670555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:20.674388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61356bb6488e44efad8566ea381d4d5d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:20.675474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61356bb6488e44efad8566ea381d4d5d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:20.692218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61356bb6488e44efad8566ea381d4d5d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:20.704337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61356bb6488e44efad8566ea381d4d5d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:20.705022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61356bb6488e44efad8566ea381d4d5d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:20.731249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1016/2052] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:20 2022] DELETE /identity/v3/users/61356bb6488e44efad8566ea381d4d5d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:20.735656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384fcb3-a985-44f6-8768-990c132adde4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:20.736226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384fcb3-a985-44f6-8768-990c132adde4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:20.736435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384fcb3-a985-44f6-8768-990c132adde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:20.760323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2384fcb3-a985-44f6-8768-990c132adde4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:20.761775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2384fcb3-a985-44f6-8768-990c132adde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:20.835907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1037/2053] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:20.849899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:20.851395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:20.922160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2e04d-0cd5-4b34-9a64-eb3165ac79bb admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:20.925933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970825b1-efec-4f48-bca3-16ef5aa8ab06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:20.926543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970825b1-efec-4f48-bca3-16ef5aa8ab06 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:20.926818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970825b1-efec-4f48-bca3-16ef5aa8ab06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:20.927120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970825b1-efec-4f48-bca3-16ef5aa8ab06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:20.936395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970825b1-efec-4f48-bca3-16ef5aa8ab06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:20.937828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970825b1-efec-4f48-bca3-16ef5aa8ab06 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:20.949102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1017/2054] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:42:21.287174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384fcb3-a985-44f6-8768-990c132adde4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:21.289032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2384fcb3-a985-44f6-8768-990c132adde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:21.308048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384fcb3-a985-44f6-8768-990c132adde4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:21.313402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:21.314071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:21.314356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:21.314633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] PATH_INFO: `/v3/projects/aef6b840b14d4407bd22d647d7616667` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:21.315960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef6b840b14d4407bd22d647d7616667)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:21.317923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:21.382840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef6b840b14d4407bd22d647d7616667', 'request_id': 'req-65e8766d-71cb-44db-8672-274b21f17878'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.387965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:21.391036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef6b840b14d4407bd22d647d7616667', 'request_id': 'req-65e8766d-71cb-44db-8672-274b21f17878'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.404101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef6b840b14d4407bd22d647d7616667', 'request_id': 'req-65e8766d-71cb-44db-8672-274b21f17878'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.420680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] The token cache is being invalidate because project aef6b840b14d4407bd22d647d7616667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:21.421069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.421714 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.423406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1038/2055] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:21 2022] DELETE /identity/v3/projects/aef6b840b14d4407bd22d647d7616667 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:21.427830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970825b1-efec-4f48-bca3-16ef5aa8ab06 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:21.439494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970825b1-efec-4f48-bca3-16ef5aa8ab06 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:21.511633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:21.512286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:21.512561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:21.512829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] PATH_INFO: `/v3/users/55290f0f0a0e44c3adf7bfac90377138` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:21.513984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55290f0f0a0e44c3adf7bfac90377138)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:21.515977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:21.573103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55290f0f0a0e44c3adf7bfac90377138'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.573864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55290f0f0a0e44c3adf7bfac90377138'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.588259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55290f0f0a0e44c3adf7bfac90377138'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.592998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:21.602862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55290f0f0a0e44c3adf7bfac90377138'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.603975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-694781af-ba2d-4ef0-a3db-1c87863fc283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55290f0f0a0e44c3adf7bfac90377138'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:21.628616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1018/2056] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:21 2022] DELETE /identity/v3/users/55290f0f0a0e44c3adf7bfac90377138 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:21.977519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:21.981971 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:21.996246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8766d-71cb-44db-8672-274b21f17878 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:22.085161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:22.085782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.086069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.086373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] PATH_INFO: `/v3/projects/fa735cb4643648cd9ddb51b20107886f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.087709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa735cb4643648cd9ddb51b20107886f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:22.090148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:22.146274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa735cb4643648cd9ddb51b20107886f', 'request_id': 'req-85977c8b-5a0a-4370-87bd-9ea7efe53de3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:22.161024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa735cb4643648cd9ddb51b20107886f', 'request_id': 'req-85977c8b-5a0a-4370-87bd-9ea7efe53de3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:22.172902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa735cb4643648cd9ddb51b20107886f', 'request_id': 'req-85977c8b-5a0a-4370-87bd-9ea7efe53de3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:22.194098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] The token cache is being invalidate because project fa735cb4643648cd9ddb51b20107886f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:22.194393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:22.195099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-85977c8b-5a0a-4370-87bd-9ea7efe53de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:22.196740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1039/2057] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:21 2022] DELETE /identity/v3/projects/fa735cb4643648cd9ddb51b20107886f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:22.203374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b724e-b6a2-4aaa-9d94-1d49f1a2efb6 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.203659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b724e-b6a2-4aaa-9d94-1d49f1a2efb6 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.203949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b724e-b6a2-4aaa-9d94-1d49f1a2efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.227983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b71b724e-b6a2-4aaa-9d94-1d49f1a2efb6 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:22.229798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b71b724e-b6a2-4aaa-9d94-1d49f1a2efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:22.298490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1019/2058] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:42:22.306963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2aafd-8c74-40aa-acc0-a343c0e5aa0f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.307338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2aafd-8c74-40aa-acc0-a343c0e5aa0f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.307621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2aafd-8c74-40aa-acc0-a343c0e5aa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.331575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-73b2aafd-8c74-40aa-acc0-a343c0e5aa0f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:22.332826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-73b2aafd-8c74-40aa-acc0-a343c0e5aa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:22.341725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1040/2059] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:22.346336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b724e-b6a2-4aaa-9d94-1d49f1a2efb6 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:22.358236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b724e-b6a2-4aaa-9d94-1d49f1a2efb6 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:22.363039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969bbf6-16cd-44e8-b76d-c8b5c886814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:22.363732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969bbf6-16cd-44e8-b76d-c8b5c886814b admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.364012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969bbf6-16cd-44e8-b76d-c8b5c886814b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.364390 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969bbf6-16cd-44e8-b76d-c8b5c886814b admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.365067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969bbf6-16cd-44e8-b76d-c8b5c886814b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:42:22.365373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969bbf6-16cd-44e8-b76d-c8b5c886814b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:22.366996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969bbf6-16cd-44e8-b76d-c8b5c886814b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:22.381089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1020/2060] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:42:22.385852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2aafd-8c74-40aa-acc0-a343c0e5aa0f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:22.395631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2aafd-8c74-40aa-acc0-a343c0e5aa0f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:22.400814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b73d-9e57-424e-9bae-9f1a9d1b2dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:22.402041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b73d-9e57-424e-9bae-9f1a9d1b2dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.402308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b73d-9e57-424e-9bae-9f1a9d1b2dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.402580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b73d-9e57-424e-9bae-9f1a9d1b2dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.403262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b73d-9e57-424e-9bae-9f1a9d1b2dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:22.405188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b73d-9e57-424e-9bae-9f1a9d1b2dd5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:22.433687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1041/2061] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:22 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:22.437960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969bbf6-16cd-44e8-b76d-c8b5c886814b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:22.448197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969bbf6-16cd-44e8-b76d-c8b5c886814b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:22.517548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e32f87-1ef0-4ce1-a72b-39bf54ac25e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:22.518180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e32f87-1ef0-4ce1-a72b-39bf54ac25e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.518466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e32f87-1ef0-4ce1-a72b-39bf54ac25e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.518751 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e32f87-1ef0-4ce1-a72b-39bf54ac25e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.519857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e32f87-1ef0-4ce1-a72b-39bf54ac25e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:22.523559 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e32f87-1ef0-4ce1-a72b-39bf54ac25e2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:22.570714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1021/2062] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:22 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:22.572030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b73d-9e57-424e-9bae-9f1a9d1b2dd5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:22.593186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b73d-9e57-424e-9bae-9f1a9d1b2dd5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:22.600568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea6d9-2735-4ff3-b171-bbf89d3833f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:22.601616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea6d9-2735-4ff3-b171-bbf89d3833f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.602091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea6d9-2735-4ff3-b171-bbf89d3833f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.602591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea6d9-2735-4ff3-b171-bbf89d3833f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.603852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea6d9-2735-4ff3-b171-bbf89d3833f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:22.606820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea6d9-2735-4ff3-b171-bbf89d3833f9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:22.626864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1042/2063] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:22.631605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e32f87-1ef0-4ce1-a72b-39bf54ac25e2 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:22.650397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e32f87-1ef0-4ce1-a72b-39bf54ac25e2 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:22.658665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d15a5-aab6-4630-9901-58b510751ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:22.659710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d15a5-aab6-4630-9901-58b510751ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.660227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d15a5-aab6-4630-9901-58b510751ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.660702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d15a5-aab6-4630-9901-58b510751ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.661908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d15a5-aab6-4630-9901-58b510751ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:22.664925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d15a5-aab6-4630-9901-58b510751ce3 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:22.682964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1022/2064] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:22.684349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea6d9-2735-4ff3-b171-bbf89d3833f9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:22.695011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea6d9-2735-4ff3-b171-bbf89d3833f9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:22.700710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571733-0e59-416f-950d-63a0e8d5be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:22.701369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571733-0e59-416f-950d-63a0e8d5be85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.701649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571733-0e59-416f-950d-63a0e8d5be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.701928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6571733-0e59-416f-950d-63a0e8d5be85 admin admin] PATH_INFO: `/v3/projects/4d24537319d74da9bbd8a80d5b822865/users/bc7c8d52d9314514b369e86ce0bdad72/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.718856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6571733-0e59-416f-950d-63a0e8d5be85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d24537319d74da9bbd8a80d5b822865, user_id=bc7c8d52d9314514b369e86ce0bdad72, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:22.721544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6571733-0e59-416f-950d-63a0e8d5be85 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:22.735141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1043/2065] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:22 2022] PUT /identity/v3/projects/4d24537319d74da9bbd8a80d5b822865/users/bc7c8d52d9314514b369e86ce0bdad72/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:22.750250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6422c44-ab46-46da-9c82-ebde8eb3c10b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:22.750567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6422c44-ab46-46da-9c82-ebde8eb3c10b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:22.750832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6422c44-ab46-46da-9c82-ebde8eb3c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:22.781904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b6422c44-ab46-46da-9c82-ebde8eb3c10b None None] MFA Rules not processed for user `bc7c8d52d9314514b369e86ce0bdad72`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:22.787141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b6422c44-ab46-46da-9c82-ebde8eb3c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:22.840206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:22.873875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1023/2066] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:31.777900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571733-0e59-416f-950d-63a0e8d5be85 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:31.780743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c6571733-0e59-416f-950d-63a0e8d5be85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:31.800685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:31.915984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6571733-0e59-416f-950d-63a0e8d5be85 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:31.923421 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:31.924485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:31.924964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:31.925451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] PATH_INFO: `/v3/users/f439f6bef139419db7007d369f010940` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:31.927202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f439f6bef139419db7007d369f010940)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:31.930243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:32.009155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f439f6bef139419db7007d369f010940'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.034078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f439f6bef139419db7007d369f010940'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.035053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f439f6bef139419db7007d369f010940'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.045646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f439f6bef139419db7007d369f010940'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.046359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f439f6bef139419db7007d369f010940'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.063331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1044/2067] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:31 2022] DELETE /identity/v3/users/f439f6bef139419db7007d369f010940 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:32.070099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d406a2-e1d8-4f0d-881c-68ff16f5e37c None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:32.070099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d406a2-e1d8-4f0d-881c-68ff16f5e37c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:32.070099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d406a2-e1d8-4f0d-881c-68ff16f5e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:32.092087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-91d406a2-e1d8-4f0d-881c-68ff16f5e37c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:32.093454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-91d406a2-e1d8-4f0d-881c-68ff16f5e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:32.196719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1024/2068] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:32.208731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:32.210915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:32.293972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527d14-60af-4aa0-abc0-d893c22edcc0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:32.297766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0967a74-ffd6-4f9e-9a94-6f5ea9d705b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:32.298385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0967a74-ffd6-4f9e-9a94-6f5ea9d705b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:32.298668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0967a74-ffd6-4f9e-9a94-6f5ea9d705b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:32.298963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0967a74-ffd6-4f9e-9a94-6f5ea9d705b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:32.310482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0967a74-ffd6-4f9e-9a94-6f5ea9d705b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:32.312081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0967a74-ffd6-4f9e-9a94-6f5ea9d705b3 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:32.325462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1045/2069] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:32.733980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d406a2-e1d8-4f0d-881c-68ff16f5e37c None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:32.736318 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-91d406a2-e1d8-4f0d-881c-68ff16f5e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:32.756976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d406a2-e1d8-4f0d-881c-68ff16f5e37c None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:32.779333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:32.780299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:32.780660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:32.781229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] PATH_INFO: `/v3/projects/d26b0d6df65b40db941130a969eaff3a` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:32.783016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26b0d6df65b40db941130a969eaff3a)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:32.785814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:32.874156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26b0d6df65b40db941130a969eaff3a', 'request_id': 'req-51e3c166-0ff0-4011-a81e-5f46e4e7b733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.883639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26b0d6df65b40db941130a969eaff3a', 'request_id': 'req-51e3c166-0ff0-4011-a81e-5f46e4e7b733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.895311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26b0d6df65b40db941130a969eaff3a', 'request_id': 'req-51e3c166-0ff0-4011-a81e-5f46e4e7b733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.925935 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] The token cache is being invalidate because project d26b0d6df65b40db941130a969eaff3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:32.926380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.929006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:32.934003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1025/2070] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:32 2022] DELETE /identity/v3/projects/d26b0d6df65b40db941130a969eaff3a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:32.939231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0967a74-ffd6-4f9e-9a94-6f5ea9d705b3 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:32.973929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0967a74-ffd6-4f9e-9a94-6f5ea9d705b3 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:33.024094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:33.076922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:33.078072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:33.078581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:33.079132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] PATH_INFO: `/v3/users/d690073fcf66479f90259e5e67a48123` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:33.081560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d690073fcf66479f90259e5e67a48123)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:33.085442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:33.159994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd690073fcf66479f90259e5e67a48123'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.179314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd690073fcf66479f90259e5e67a48123'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.180335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd690073fcf66479f90259e5e67a48123'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.191523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd690073fcf66479f90259e5e67a48123'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.192714 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3ba28008-31bc-4636-9232-33f1c95ba448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd690073fcf66479f90259e5e67a48123'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.216512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1046/2071] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:32 2022] DELETE /identity/v3/users/d690073fcf66479f90259e5e67a48123 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:33.634417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:33.636780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:33.662529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3c166-0ff0-4011-a81e-5f46e4e7b733 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:33.770340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:33.771438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:33.771925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:33.772406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] PATH_INFO: `/v3/projects/b81c4ac5e83543ecb8d3827a7735bec9` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:33.774629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81c4ac5e83543ecb8d3827a7735bec9)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:33.779161 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:33.784138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:33.856973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81c4ac5e83543ecb8d3827a7735bec9', 'request_id': 'req-9d7bec9b-714a-42b1-bb48-152d123ca02e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.867507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81c4ac5e83543ecb8d3827a7735bec9', 'request_id': 'req-9d7bec9b-714a-42b1-bb48-152d123ca02e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.874677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81c4ac5e83543ecb8d3827a7735bec9', 'request_id': 'req-9d7bec9b-714a-42b1-bb48-152d123ca02e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.887739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] The token cache is being invalidate because project b81c4ac5e83543ecb8d3827a7735bec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:33.888031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.888755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9d7bec9b-714a-42b1-bb48-152d123ca02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:33.890468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1026/2072] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:33 2022] DELETE /identity/v3/projects/b81c4ac5e83543ecb8d3827a7735bec9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:33.900869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4bd6-68fe-4f57-b4b3-fa2730ff6467 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:33.902061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4bd6-68fe-4f57-b4b3-fa2730ff6467 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:33.902532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4bd6-68fe-4f57-b4b3-fa2730ff6467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:33.932763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-af1f4bd6-68fe-4f57-b4b3-fa2730ff6467 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:33.934636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-af1f4bd6-68fe-4f57-b4b3-fa2730ff6467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:34.045653 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1047/2073] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:34.056596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee60732-81fd-412a-ab31-45179379c09a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:34.056881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee60732-81fd-412a-ab31-45179379c09a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:34.057204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee60732-81fd-412a-ab31-45179379c09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:34.097917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7ee60732-81fd-412a-ab31-45179379c09a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:34.099990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7ee60732-81fd-412a-ab31-45179379c09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:34.114536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1027/2074] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:34.121132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f4bd6-68fe-4f57-b4b3-fa2730ff6467 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:34.143248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f4bd6-68fe-4f57-b4b3-fa2730ff6467 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:34.152749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80478d3-3e93-4964-9f5c-757e4fbf86ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:34.153684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80478d3-3e93-4964-9f5c-757e4fbf86ba admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:34.154106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80478d3-3e93-4964-9f5c-757e4fbf86ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:34.154532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80478d3-3e93-4964-9f5c-757e4fbf86ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:34.155660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80478d3-3e93-4964-9f5c-757e4fbf86ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:42:34.156237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80478d3-3e93-4964-9f5c-757e4fbf86ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:34.159177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80478d3-3e93-4964-9f5c-757e4fbf86ba admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:34.189289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1048/2075] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:42:34.194012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee60732-81fd-412a-ab31-45179379c09a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:34.230040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee60732-81fd-412a-ab31-45179379c09a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:34.241598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c45c6-8b20-48ee-9485-5f5e4f59b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:34.242280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c45c6-8b20-48ee-9485-5f5e4f59b33d admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:34.242569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c45c6-8b20-48ee-9485-5f5e4f59b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:34.242850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c45c6-8b20-48ee-9485-5f5e4f59b33d admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:34.244032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c45c6-8b20-48ee-9485-5f5e4f59b33d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:34.248612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c45c6-8b20-48ee-9485-5f5e4f59b33d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:34.309040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1028/2076] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:34 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:34.315508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80478d3-3e93-4964-9f5c-757e4fbf86ba admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:34.345591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80478d3-3e93-4964-9f5c-757e4fbf86ba admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:34.430782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:34.484230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdac3d-367c-40fe-ade4-ff163cc945a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:34.485246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdac3d-367c-40fe-ade4-ff163cc945a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:34.485757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdac3d-367c-40fe-ade4-ff163cc945a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:34.486207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdac3d-367c-40fe-ade4-ff163cc945a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:34.487460 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdac3d-367c-40fe-ade4-ff163cc945a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:34.491476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdac3d-367c-40fe-ade4-ff163cc945a0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:34.552712 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1049/2077] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:34 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:34.560356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c45c6-8b20-48ee-9485-5f5e4f59b33d admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:34.574804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c45c6-8b20-48ee-9485-5f5e4f59b33d admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:34.581432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefb5a4-6ee1-42d0-a00b-113e645b7067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:34.582191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefb5a4-6ee1-42d0-a00b-113e645b7067 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:34.583741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefb5a4-6ee1-42d0-a00b-113e645b7067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:34.584050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefb5a4-6ee1-42d0-a00b-113e645b7067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:34.584741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefb5a4-6ee1-42d0-a00b-113e645b7067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:34.587153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefb5a4-6ee1-42d0-a00b-113e645b7067 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:34.614514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1029/2078] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:42:34.618552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdac3d-367c-40fe-ade4-ff163cc945a0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:34.631491 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdac3d-367c-40fe-ade4-ff163cc945a0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:34.638540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd212ec-fd65-4f71-9104-19128180868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:34.639338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd212ec-fd65-4f71-9104-19128180868f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:34.639792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd212ec-fd65-4f71-9104-19128180868f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:34.640033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd212ec-fd65-4f71-9104-19128180868f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:34.640730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd212ec-fd65-4f71-9104-19128180868f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:34.642450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd212ec-fd65-4f71-9104-19128180868f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:34.688611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1050/2079] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:34.692811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefb5a4-6ee1-42d0-a00b-113e645b7067 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:34.720048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefb5a4-6ee1-42d0-a00b-113e645b7067 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:34.727370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc4099-1f83-4c77-9668-601cac759f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:34.728086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc4099-1f83-4c77-9668-601cac759f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:34.728373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc4099-1f83-4c77-9668-601cac759f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:34.728655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc4099-1f83-4c77-9668-601cac759f59 admin admin] PATH_INFO: `/v3/projects/b6bacecea8fb44a2962047f7cdeecf66/users/d1af02c2f6b1484ab24dc6d5b5311e43/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:34.765235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc4099-1f83-4c77-9668-601cac759f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bacecea8fb44a2962047f7cdeecf66, user_id=d1af02c2f6b1484ab24dc6d5b5311e43, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:34.770747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc4099-1f83-4c77-9668-601cac759f59 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:34.828986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1030/2080] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:34 2022] PUT /identity/v3/projects/b6bacecea8fb44a2962047f7cdeecf66/users/d1af02c2f6b1484ab24dc6d5b5311e43/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:34.847360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da688d61-c844-48cf-83f1-27f9f052258c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:34.848363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da688d61-c844-48cf-83f1-27f9f052258c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:34.849539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da688d61-c844-48cf-83f1-27f9f052258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:34.904758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-da688d61-c844-48cf-83f1-27f9f052258c None None] MFA Rules not processed for user `d1af02c2f6b1484ab24dc6d5b5311e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:34.906798 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-da688d61-c844-48cf-83f1-27f9f052258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:35.032011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1051/2081] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:35.039619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc4099-1f83-4c77-9668-601cac759f59 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:35.180440 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc4099-1f83-4c77-9668-601cac759f59 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:35.186233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4670-912e-4045-b3a7-c3e2a7f722e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:35.186977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4670-912e-4045-b3a7-c3e2a7f722e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:35.187267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4670-912e-4045-b3a7-c3e2a7f722e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:35.187544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b4670-912e-4045-b3a7-c3e2a7f722e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:35.188235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4670-912e-4045-b3a7-c3e2a7f722e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:35.190510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b4670-912e-4045-b3a7-c3e2a7f722e5 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:35.234326 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1031/2082] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:35 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:35.240189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da688d61-c844-48cf-83f1-27f9f052258c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:35.255970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da688d61-c844-48cf-83f1-27f9f052258c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:35.350961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a598b85-9490-4dd8-a730-89f9cd505a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:35.351484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a598b85-9490-4dd8-a730-89f9cd505a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:35.351790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a598b85-9490-4dd8-a730-89f9cd505a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:35.352150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a598b85-9490-4dd8-a730-89f9cd505a8b admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:35.352897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a598b85-9490-4dd8-a730-89f9cd505a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:35.355658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a598b85-9490-4dd8-a730-89f9cd505a8b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:35.383546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1052/2083] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:35 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:35.388775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4670-912e-4045-b3a7-c3e2a7f722e5 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:35.400803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b4670-912e-4045-b3a7-c3e2a7f722e5 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:35.406398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b217a-a166-40e2-92ce-106554c0c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:35.407195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b217a-a166-40e2-92ce-106554c0c279 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:35.407479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b217a-a166-40e2-92ce-106554c0c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:35.407766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b217a-a166-40e2-92ce-106554c0c279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:35.408471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b217a-a166-40e2-92ce-106554c0c279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:35.410118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b217a-a166-40e2-92ce-106554c0c279 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:35.421575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1032/2084] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:42:35.428754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a598b85-9490-4dd8-a730-89f9cd505a8b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:35.446796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a598b85-9490-4dd8-a730-89f9cd505a8b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:35.455676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ea8ec-bff5-4d62-8601-c14363a94256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:35.456499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea8ec-bff5-4d62-8601-c14363a94256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:35.456776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea8ec-bff5-4d62-8601-c14363a94256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:35.457051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea8ec-bff5-4d62-8601-c14363a94256 admin admin] PATH_INFO: `/v3/projects/b6a6c92c364149a687a6ffe465b51ba4/users/8e8eb25107d54fe7baf0d0a1553e4bf8/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:35.478611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ea8ec-bff5-4d62-8601-c14363a94256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a6c92c364149a687a6ffe465b51ba4, user_id=8e8eb25107d54fe7baf0d0a1553e4bf8, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:35.483227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ea8ec-bff5-4d62-8601-c14363a94256 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:35.500218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1053/2085] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:35 2022] PUT /identity/v3/projects/b6a6c92c364149a687a6ffe465b51ba4/users/8e8eb25107d54fe7baf0d0a1553e4bf8/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:35.504874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b217a-a166-40e2-92ce-106554c0c279 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:35.514137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:35.521669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b217a-a166-40e2-92ce-106554c0c279 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:35.601260 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592328a6-e5c7-47e8-8cfc-6a6e06c44ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:35.602347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592328a6-e5c7-47e8-8cfc-6a6e06c44ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:35.602854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592328a6-e5c7-47e8-8cfc-6a6e06c44ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:35.603377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592328a6-e5c7-47e8-8cfc-6a6e06c44ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:35.604581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592328a6-e5c7-47e8-8cfc-6a6e06c44ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:35.610011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592328a6-e5c7-47e8-8cfc-6a6e06c44ad0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:35.620791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1033/2086] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:42:35.626923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ea8ec-bff5-4d62-8601-c14363a94256 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:35.640568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ea8ec-bff5-4d62-8601-c14363a94256 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:35.646055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e6019-e182-4f7f-a443-b471a610286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:35.646751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e6019-e182-4f7f-a443-b471a610286a admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:35.647065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e6019-e182-4f7f-a443-b471a610286a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:35.647344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e6019-e182-4f7f-a443-b471a610286a admin admin] PATH_INFO: `/v3/projects/b6a6c92c364149a687a6ffe465b51ba4/users/8e8eb25107d54fe7baf0d0a1553e4bf8/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:35.649775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e6019-e182-4f7f-a443-b471a610286a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a6c92c364149a687a6ffe465b51ba4, user_id=8e8eb25107d54fe7baf0d0a1553e4bf8, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:35.653279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e6019-e182-4f7f-a443-b471a610286a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:35.660306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:35.678557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1054/2087] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:35 2022] PUT /identity/v3/projects/b6a6c92c364149a687a6ffe465b51ba4/users/8e8eb25107d54fe7baf0d0a1553e4bf8/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:35.695082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257c5c-6764-44df-a21f-80e438ebf259 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:35.695082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257c5c-6764-44df-a21f-80e438ebf259 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:35.695082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257c5c-6764-44df-a21f-80e438ebf259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:35.729209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-35257c5c-6764-44df-a21f-80e438ebf259 None None] MFA Rules not processed for user `8e8eb25107d54fe7baf0d0a1553e4bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:35.730508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-35257c5c-6764-44df-a21f-80e438ebf259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:35.886369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1034/2088] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:42:35.904423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e6019-e182-4f7f-a443-b471a610286a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:35.906317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b19e6019-e182-4f7f-a443-b471a610286a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:36.000574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e6019-e182-4f7f-a443-b471a610286a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:36.005978 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29210e91-dc26-4597-8ca8-92bd1aeeeffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:36.007069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29210e91-dc26-4597-8ca8-92bd1aeeeffc service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:36.007557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29210e91-dc26-4597-8ca8-92bd1aeeeffc service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:36.008177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29210e91-dc26-4597-8ca8-92bd1aeeeffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:36.031800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29210e91-dc26-4597-8ca8-92bd1aeeeffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:36.035361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29210e91-dc26-4597-8ca8-92bd1aeeeffc service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:36.057390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1055/2089] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:42:36.175619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35257c5c-6764-44df-a21f-80e438ebf259 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:36.189945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35257c5c-6764-44df-a21f-80e438ebf259 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:36.205228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270e588-670b-4d77-a24c-7a8ad6fd42eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:36.206424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e588-670b-4d77-a24c-7a8ad6fd42eb service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:36.207588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e588-670b-4d77-a24c-7a8ad6fd42eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:36.208100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e588-670b-4d77-a24c-7a8ad6fd42eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:36.340757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270e588-670b-4d77-a24c-7a8ad6fd42eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:36.344348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270e588-670b-4d77-a24c-7a8ad6fd42eb service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:36.384216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1035/2090] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:38.185831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29210e91-dc26-4597-8ca8-92bd1aeeeffc service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:38.187843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-29210e91-dc26-4597-8ca8-92bd1aeeeffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:38.348250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29210e91-dc26-4597-8ca8-92bd1aeeeffc service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:38.362566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84890-ae6f-4088-a405-c86a9579ee05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d055337c9a642bd9b8b5a60aacb11cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:38.363689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84890-ae6f-4088-a405-c86a9579ee05 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:38.364198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84890-ae6f-4088-a405-c86a9579ee05 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:38.364710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84890-ae6f-4088-a405-c86a9579ee05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:38.367582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5df84890-ae6f-4088-a405-c86a9579ee05 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:38.481137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df84890-ae6f-4088-a405-c86a9579ee05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:38.482596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df84890-ae6f-4088-a405-c86a9579ee05 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:38.496812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1056/2091] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:40.238190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270e588-670b-4d77-a24c-7a8ad6fd42eb service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:40.299065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:40.390510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270e588-670b-4d77-a24c-7a8ad6fd42eb service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:40.400004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:40.400844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:40.401772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:40.402395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] PATH_INFO: `/v3/users/d1af02c2f6b1484ab24dc6d5b5311e43` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:40.404328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1af02c2f6b1484ab24dc6d5b5311e43)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:40.407250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:40.526049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1af02c2f6b1484ab24dc6d5b5311e43'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:40.528236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1af02c2f6b1484ab24dc6d5b5311e43'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:40.552261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1af02c2f6b1484ab24dc6d5b5311e43'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:40.577201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1af02c2f6b1484ab24dc6d5b5311e43'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:40.579347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1af02c2f6b1484ab24dc6d5b5311e43'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:40.649325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82d46-7d61-449c-b1a5-c7b697ce35c7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:40.650121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82d46-7d61-449c-b1a5-c7b697ce35c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:40.650121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e82d46-7d61-449c-b1a5-c7b697ce35c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:40.653679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1036/2092] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:40 2022] DELETE /identity/v3/users/d1af02c2f6b1484ab24dc6d5b5311e43 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:40.721175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-07e82d46-7d61-449c-b1a5-c7b697ce35c7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:40.727725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-07e82d46-7d61-449c-b1a5-c7b697ce35c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:40.789553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:40.875731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1057/2093] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:40.890648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:40.892352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:40.997813 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308affeb-8354-4622-88bf-8090cbce847b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:41.001496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557d1ff-d8ea-4236-9bdd-5d0d8af9f32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:41.002109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557d1ff-d8ea-4236-9bdd-5d0d8af9f32f service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:41.002389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557d1ff-d8ea-4236-9bdd-5d0d8af9f32f service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:41.002664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557d1ff-d8ea-4236-9bdd-5d0d8af9f32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:41.013742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557d1ff-d8ea-4236-9bdd-5d0d8af9f32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:41.015225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557d1ff-d8ea-4236-9bdd-5d0d8af9f32f service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:41.028177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1037/2094] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:41.455791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e82d46-7d61-449c-b1a5-c7b697ce35c7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:41.458386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-07e82d46-7d61-449c-b1a5-c7b697ce35c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:41.485986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e82d46-7d61-449c-b1a5-c7b697ce35c7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:41.513103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:41.514440 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:41.515486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:41.516041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] PATH_INFO: `/v3/projects/b6bacecea8fb44a2962047f7cdeecf66` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:41.519852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bacecea8fb44a2962047f7cdeecf66)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:41.524296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:41.620068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bacecea8fb44a2962047f7cdeecf66', 'request_id': 'req-4379f104-5639-49a3-9865-ef835dfe26f2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:41.632375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bacecea8fb44a2962047f7cdeecf66', 'request_id': 'req-4379f104-5639-49a3-9865-ef835dfe26f2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:41.644424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bacecea8fb44a2962047f7cdeecf66', 'request_id': 'req-4379f104-5639-49a3-9865-ef835dfe26f2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:41.674233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] The token cache is being invalidate because project b6bacecea8fb44a2962047f7cdeecf66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:41.675345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:41.676121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:41.683959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1058/2095] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:41 2022] DELETE /identity/v3/projects/b6bacecea8fb44a2962047f7cdeecf66 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:41.686985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557d1ff-d8ea-4236-9bdd-5d0d8af9f32f service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:41.704793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557d1ff-d8ea-4236-9bdd-5d0d8af9f32f service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:41.797791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:41.837661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:41.839948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:41.840699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:41.841176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] PATH_INFO: `/v3/users/8e8eb25107d54fe7baf0d0a1553e4bf8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:41.842899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8eb25107d54fe7baf0d0a1553e4bf8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:41.845732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:41.963055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8eb25107d54fe7baf0d0a1553e4bf8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:41.972344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8eb25107d54fe7baf0d0a1553e4bf8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:42.011222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8eb25107d54fe7baf0d0a1553e4bf8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:42.024709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8eb25107d54fe7baf0d0a1553e4bf8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:42.026683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-5ef8e33c-a6c7-4277-b327-c9252587eecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8eb25107d54fe7baf0d0a1553e4bf8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:42.053533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1038/2096] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:41 2022] DELETE /identity/v3/users/8e8eb25107d54fe7baf0d0a1553e4bf8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:42.636380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:42.639494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:42.661408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381ab1-c6af-42bb-9047-9aa369fc3299 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:42.661752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381ab1-c6af-42bb-9047-9aa369fc3299 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:42.662044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381ab1-c6af-42bb-9047-9aa369fc3299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:42.674597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379f104-5639-49a3-9865-ef835dfe26f2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:42.700185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c5381ab1-c6af-42bb-9047-9aa369fc3299 None None] MFA Rules not processed for user `e56d4b78d51b4a81842f5724aaff7f85`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:42.702331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c5381ab1-c6af-42bb-9047-9aa369fc3299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:42.766767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:42.767294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:42.767496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:42.767781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] PATH_INFO: `/v3/projects/b6a6c92c364149a687a6ffe465b51ba4` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:42.769929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a6c92c364149a687a6ffe465b51ba4)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:42.772017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:42.797284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1039/2097] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:42.883556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a6c92c364149a687a6ffe465b51ba4', 'request_id': 'req-2e1759f3-d7bb-455b-9c46-f744844b1158'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:42.895194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a6c92c364149a687a6ffe465b51ba4', 'request_id': 'req-2e1759f3-d7bb-455b-9c46-f744844b1158'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:42.900190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:42.929717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a6c92c364149a687a6ffe465b51ba4', 'request_id': 'req-2e1759f3-d7bb-455b-9c46-f744844b1158'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:42.971516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] The token cache is being invalidate because project b6a6c92c364149a687a6ffe465b51ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:42.971983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:42.973488 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2e1759f3-d7bb-455b-9c46-f744844b1158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:42.975786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1059/2098] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:42 2022] DELETE /identity/v3/projects/b6a6c92c364149a687a6ffe465b51ba4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:42.980981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a67e36-51f4-4c6b-a97d-428733cefc73 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:42.981242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a67e36-51f4-4c6b-a97d-428733cefc73 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:42.981594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a67e36-51f4-4c6b-a97d-428733cefc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:43.024849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-d6a67e36-51f4-4c6b-a97d-428733cefc73 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:43.027247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d6a67e36-51f4-4c6b-a97d-428733cefc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:43.120491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1040/2099] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:43.133672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab9e7-6359-4af1-b75f-23818b6f6e3a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:43.133996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab9e7-6359-4af1-b75f-23818b6f6e3a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:43.138919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab9e7-6359-4af1-b75f-23818b6f6e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:43.167365 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-eb2ab9e7-6359-4af1-b75f-23818b6f6e3a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:43.168599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-eb2ab9e7-6359-4af1-b75f-23818b6f6e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:43.177993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1060/2100] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:43.183179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a67e36-51f4-4c6b-a97d-428733cefc73 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:43.203855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a67e36-51f4-4c6b-a97d-428733cefc73 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:43.212490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abfaac-7069-48c2-9f16-f36ebb558f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:43.213399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abfaac-7069-48c2-9f16-f36ebb558f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:43.214454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abfaac-7069-48c2-9f16-f36ebb558f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:43.214744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abfaac-7069-48c2-9f16-f36ebb558f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:43.215628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abfaac-7069-48c2-9f16-f36ebb558f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:42:43.215953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abfaac-7069-48c2-9f16-f36ebb558f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:43.217638 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abfaac-7069-48c2-9f16-f36ebb558f21 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:43.220787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:43.233780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1041/2101] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:42:43.238231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab9e7-6359-4af1-b75f-23818b6f6e3a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:43.248737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab9e7-6359-4af1-b75f-23818b6f6e3a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:43.256124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f2888-37ea-4513-92c0-f4e48203e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:43.257175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f2888-37ea-4513-92c0-f4e48203e0ba admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:43.257175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f2888-37ea-4513-92c0-f4e48203e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:43.257575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f2888-37ea-4513-92c0-f4e48203e0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:43.258210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f2888-37ea-4513-92c0-f4e48203e0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:43.260333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f2888-37ea-4513-92c0-f4e48203e0ba admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:43.305251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1061/2102] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:43 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:43.306857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abfaac-7069-48c2-9f16-f36ebb558f21 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:43.318151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abfaac-7069-48c2-9f16-f36ebb558f21 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:43.434471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b9f87-2467-47ab-ae74-0459753f5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:43.435983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9f87-2467-47ab-ae74-0459753f5962 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:43.436543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9f87-2467-47ab-ae74-0459753f5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:43.437058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9f87-2467-47ab-ae74-0459753f5962 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:43.439182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b9f87-2467-47ab-ae74-0459753f5962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:43.448699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b9f87-2467-47ab-ae74-0459753f5962 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:43.496321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1042/2103] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:43 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:43.501345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f2888-37ea-4513-92c0-f4e48203e0ba admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:43.525815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f2888-37ea-4513-92c0-f4e48203e0ba admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:43.532985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b80dd-47d6-46eb-9cc2-7ab48c6e8aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:43.533785 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b80dd-47d6-46eb-9cc2-7ab48c6e8aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:43.534427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b80dd-47d6-46eb-9cc2-7ab48c6e8aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:43.534986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b80dd-47d6-46eb-9cc2-7ab48c6e8aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:43.536198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b80dd-47d6-46eb-9cc2-7ab48c6e8aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:43.539974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b80dd-47d6-46eb-9cc2-7ab48c6e8aa6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:43.563530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1062/2104] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:43.565650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b9f87-2467-47ab-ae74-0459753f5962 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:43.577841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b9f87-2467-47ab-ae74-0459753f5962 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:43.583586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8220a-91eb-405e-bbfa-951fd3dd2b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:43.584445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8220a-91eb-405e-bbfa-951fd3dd2b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:43.584883 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8220a-91eb-405e-bbfa-951fd3dd2b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:43.587467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8220a-91eb-405e-bbfa-951fd3dd2b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:43.587467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8220a-91eb-405e-bbfa-951fd3dd2b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:43.589437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8220a-91eb-405e-bbfa-951fd3dd2b1a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:43.611950 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1043/2105] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:43.614207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b80dd-47d6-46eb-9cc2-7ab48c6e8aa6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:43.635029 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b80dd-47d6-46eb-9cc2-7ab48c6e8aa6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:43.642820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb283407-7ec6-4177-9d97-9f9cda6f4252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:43.643772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb283407-7ec6-4177-9d97-9f9cda6f4252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:43.644126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb283407-7ec6-4177-9d97-9f9cda6f4252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:43.644550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb283407-7ec6-4177-9d97-9f9cda6f4252 admin admin] PATH_INFO: `/v3/projects/4e6ac1d431304ddda1d6f8591028debf/users/743871ea8773433c9908ae2573f2618f/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:43.665159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb283407-7ec6-4177-9d97-9f9cda6f4252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6ac1d431304ddda1d6f8591028debf, user_id=743871ea8773433c9908ae2573f2618f, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:43.668541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb283407-7ec6-4177-9d97-9f9cda6f4252 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:43.689138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1063/2106] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:43 2022] PUT /identity/v3/projects/4e6ac1d431304ddda1d6f8591028debf/users/743871ea8773433c9908ae2573f2618f/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:43.709258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd70877-a001-4d12-a6cc-3c909b8cf11c None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:43.710183 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd70877-a001-4d12-a6cc-3c909b8cf11c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:43.710625 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd70877-a001-4d12-a6cc-3c909b8cf11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:43.754249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5bd70877-a001-4d12-a6cc-3c909b8cf11c None None] MFA Rules not processed for user `743871ea8773433c9908ae2573f2618f`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:43.755811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5bd70877-a001-4d12-a6cc-3c909b8cf11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:43.871966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1044/2107] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:43.879096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb283407-7ec6-4177-9d97-9f9cda6f4252 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:44.001531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb283407-7ec6-4177-9d97-9f9cda6f4252 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:44.037719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2da7a0-427d-4743-a410-d62b6b82105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:44.043279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2da7a0-427d-4743-a410-d62b6b82105e admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:44.043773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2da7a0-427d-4743-a410-d62b6b82105e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:44.044239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2da7a0-427d-4743-a410-d62b6b82105e admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:44.045498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2da7a0-427d-4743-a410-d62b6b82105e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:44.060048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2da7a0-427d-4743-a410-d62b6b82105e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:44.198009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1064/2108] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:43 2022] POST /identity/v3/projects => generated 387 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:44.200606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd70877-a001-4d12-a6cc-3c909b8cf11c None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:44.248674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd70877-a001-4d12-a6cc-3c909b8cf11c None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:44.374250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468ce1-d3f9-4f2d-949e-3e76e1406e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:44.375158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468ce1-d3f9-4f2d-949e-3e76e1406e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:44.375442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468ce1-d3f9-4f2d-949e-3e76e1406e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:44.375722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468ce1-d3f9-4f2d-949e-3e76e1406e7e admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:44.376562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54468ce1-d3f9-4f2d-949e-3e76e1406e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:44.383934 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54468ce1-d3f9-4f2d-949e-3e76e1406e7e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:44.422913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:44.462157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1045/2109] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:44 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:42:44.464854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2da7a0-427d-4743-a410-d62b6b82105e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:44.487875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2da7a0-427d-4743-a410-d62b6b82105e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:44.495065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91781a46-d511-4d23-bb86-dd3cad987f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:44.495732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91781a46-d511-4d23-bb86-dd3cad987f02 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:44.496017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91781a46-d511-4d23-bb86-dd3cad987f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:44.496293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91781a46-d511-4d23-bb86-dd3cad987f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:44.496966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91781a46-d511-4d23-bb86-dd3cad987f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:44.498669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91781a46-d511-4d23-bb86-dd3cad987f02 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:44.519287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1065/2110] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:44.521060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468ce1-d3f9-4f2d-949e-3e76e1406e7e admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:44.562913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468ce1-d3f9-4f2d-949e-3e76e1406e7e admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:44.582773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b77f57-6090-4a49-aed1-ca7e35bb893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:44.587341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77f57-6090-4a49-aed1-ca7e35bb893a admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:44.587757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77f57-6090-4a49-aed1-ca7e35bb893a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:44.588178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77f57-6090-4a49-aed1-ca7e35bb893a admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:44.589500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b77f57-6090-4a49-aed1-ca7e35bb893a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:44.593529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b77f57-6090-4a49-aed1-ca7e35bb893a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:44.614999 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1046/2111] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:44.620730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91781a46-d511-4d23-bb86-dd3cad987f02 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:44.639552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91781a46-d511-4d23-bb86-dd3cad987f02 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:44.652106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e02f4-c170-4151-ad69-19197c8bdee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:44.653235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e02f4-c170-4151-ad69-19197c8bdee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:44.653721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e02f4-c170-4151-ad69-19197c8bdee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:44.655935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e02f4-c170-4151-ad69-19197c8bdee9 admin admin] PATH_INFO: `/v3/projects/b862264eceea44159c6d03c9ffe49f5c/users/03fb91f223ad445c93518bf73e25f52e/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:44.687083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e02f4-c170-4151-ad69-19197c8bdee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b862264eceea44159c6d03c9ffe49f5c, user_id=03fb91f223ad445c93518bf73e25f52e, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:44.692332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e02f4-c170-4151-ad69-19197c8bdee9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:44.720157 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1066/2112] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:44 2022] PUT /identity/v3/projects/b862264eceea44159c6d03c9ffe49f5c/users/03fb91f223ad445c93518bf73e25f52e/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:44.742261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae981a7-048a-4d7e-bdc2-6b20cd35ce94 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:44.743674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae981a7-048a-4d7e-bdc2-6b20cd35ce94 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:44.744045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae981a7-048a-4d7e-bdc2-6b20cd35ce94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:44.805533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5ae981a7-048a-4d7e-bdc2-6b20cd35ce94 None None] MFA Rules not processed for user `03fb91f223ad445c93518bf73e25f52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:44.808545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5ae981a7-048a-4d7e-bdc2-6b20cd35ce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:44.940279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1047/2113] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:44.941504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e02f4-c170-4151-ad69-19197c8bdee9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:44.999523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:45.036933 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e02f4-c170-4151-ad69-19197c8bdee9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:45.042807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e8e81-c8a7-4398-adfb-8dd798c78753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:45.043475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e8e81-c8a7-4398-adfb-8dd798c78753 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:45.046691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e8e81-c8a7-4398-adfb-8dd798c78753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:45.046691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e8e81-c8a7-4398-adfb-8dd798c78753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:45.046691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e8e81-c8a7-4398-adfb-8dd798c78753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:45.047287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e8e81-c8a7-4398-adfb-8dd798c78753 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:45.089015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1067/2114] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:42:44 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:45.094835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae981a7-048a-4d7e-bdc2-6b20cd35ce94 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:45.110743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae981a7-048a-4d7e-bdc2-6b20cd35ce94 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:45.217253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0dbf-0718-4e4a-a187-b1e6a4b39e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:45.219244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0dbf-0718-4e4a-a187-b1e6a4b39e26 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:45.219724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0dbf-0718-4e4a-a187-b1e6a4b39e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:45.220285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0dbf-0718-4e4a-a187-b1e6a4b39e26 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:45.221554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e0dbf-0718-4e4a-a187-b1e6a4b39e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:45.226008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e0dbf-0718-4e4a-a187-b1e6a4b39e26 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:45.296709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1048/2115] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:42:45 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:42:45.297185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e8e81-c8a7-4398-adfb-8dd798c78753 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:45.323702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e8e81-c8a7-4398-adfb-8dd798c78753 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:45.334314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d898-1c92-4c0d-aa86-d48ae8ae8931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:45.335997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d898-1c92-4c0d-aa86-d48ae8ae8931 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:45.337178 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d898-1c92-4c0d-aa86-d48ae8ae8931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:45.337826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d898-1c92-4c0d-aa86-d48ae8ae8931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:45.344186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249d898-1c92-4c0d-aa86-d48ae8ae8931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:45.360776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249d898-1c92-4c0d-aa86-d48ae8ae8931 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:45.415688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1068/2116] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:45.416601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0dbf-0718-4e4a-a187-b1e6a4b39e26 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:45.434785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0dbf-0718-4e4a-a187-b1e6a4b39e26 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:45.446229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b20e7-5d56-4593-b7f3-03191d6eb85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:45.447999 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b20e7-5d56-4593-b7f3-03191d6eb85d admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:45.449119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b20e7-5d56-4593-b7f3-03191d6eb85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:45.450117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b20e7-5d56-4593-b7f3-03191d6eb85d admin admin] PATH_INFO: `/v3/projects/59a277f795ce4d4b8d57276dc1111e60/users/037cb3d82eb14a7c8fccbdba28f0e333/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:45.476693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b20e7-5d56-4593-b7f3-03191d6eb85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a277f795ce4d4b8d57276dc1111e60, user_id=037cb3d82eb14a7c8fccbdba28f0e333, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:45.482891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b20e7-5d56-4593-b7f3-03191d6eb85d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:45.509239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1049/2117] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:45 2022] PUT /identity/v3/projects/59a277f795ce4d4b8d57276dc1111e60/users/037cb3d82eb14a7c8fccbdba28f0e333/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:45.513789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d898-1c92-4c0d-aa86-d48ae8ae8931 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:45.545911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d898-1c92-4c0d-aa86-d48ae8ae8931 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:45.656143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b7b8-3f9d-4deb-aa72-81098edc2ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:45.656916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b7b8-3f9d-4deb-aa72-81098edc2ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:45.657505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b7b8-3f9d-4deb-aa72-81098edc2ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:45.657997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b7b8-3f9d-4deb-aa72-81098edc2ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:45.659488 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b7b8-3f9d-4deb-aa72-81098edc2ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:45.661796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b7b8-3f9d-4deb-aa72-81098edc2ea2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:45.679837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b20e7-5d56-4593-b7f3-03191d6eb85d admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:45.680512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1069/2118] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:42:45.694802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b20e7-5d56-4593-b7f3-03191d6eb85d admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:45.702351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38763d-230f-4f89-941f-8b1bc94f55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:45.703182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38763d-230f-4f89-941f-8b1bc94f55e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:45.703578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38763d-230f-4f89-941f-8b1bc94f55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:45.703991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38763d-230f-4f89-941f-8b1bc94f55e2 admin admin] PATH_INFO: `/v3/projects/59a277f795ce4d4b8d57276dc1111e60/users/037cb3d82eb14a7c8fccbdba28f0e333/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:45.706848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38763d-230f-4f89-941f-8b1bc94f55e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a277f795ce4d4b8d57276dc1111e60, user_id=037cb3d82eb14a7c8fccbdba28f0e333, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:45.712797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38763d-230f-4f89-941f-8b1bc94f55e2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:45.739610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1050/2119] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:42:45 2022] PUT /identity/v3/projects/59a277f795ce4d4b8d57276dc1111e60/users/037cb3d82eb14a7c8fccbdba28f0e333/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:45.746300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a0644-537f-4e28-94a7-4dd6cfe758ec None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:45.749852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a0644-537f-4e28-94a7-4dd6cfe758ec None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:45.750342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a0644-537f-4e28-94a7-4dd6cfe758ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:45.794522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-469a0644-537f-4e28-94a7-4dd6cfe758ec None None] MFA Rules not processed for user `037cb3d82eb14a7c8fccbdba28f0e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:45.796669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-469a0644-537f-4e28-94a7-4dd6cfe758ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:45.957314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1070/2120] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:45.984412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38763d-230f-4f89-941f-8b1bc94f55e2 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:45.988707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7e38763d-230f-4f89-941f-8b1bc94f55e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:46.058282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:46.147754 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38763d-230f-4f89-941f-8b1bc94f55e2 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:46.154339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa60b4-9f42-499a-a857-fc6455545595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:46.155289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa60b4-9f42-499a-a857-fc6455545595 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:46.155689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa60b4-9f42-499a-a857-fc6455545595 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:46.156156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa60b4-9f42-499a-a857-fc6455545595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:46.176528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa60b4-9f42-499a-a857-fc6455545595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:46.180266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa60b4-9f42-499a-a857-fc6455545595 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:46.214300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1051/2121] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:47.130296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a0644-537f-4e28-94a7-4dd6cfe758ec None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:47.131884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-469a0644-537f-4e28-94a7-4dd6cfe758ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:47.148798 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a0644-537f-4e28-94a7-4dd6cfe758ec None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:47.154117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75f23f-4c40-48a5-861d-5d50e5e6a52f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:47.154736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75f23f-4c40-48a5-861d-5d50e5e6a52f service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:47.155094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75f23f-4c40-48a5-861d-5d50e5e6a52f service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:47.155476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75f23f-4c40-48a5-861d-5d50e5e6a52f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:47.192689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:47.235296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75f23f-4c40-48a5-861d-5d50e5e6a52f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:47.236743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75f23f-4c40-48a5-861d-5d50e5e6a52f service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:47.247439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1071/2122] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:52.483035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa60b4-9f42-499a-a857-fc6455545595 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:52.506484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa60b4-9f42-499a-a857-fc6455545595 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:52.533914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ca6d0-b319-484c-a5d5-d982d2b4475e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:52.534548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ca6d0-b319-484c-a5d5-d982d2b4475e service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:52.534826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ca6d0-b319-484c-a5d5-d982d2b4475e service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:52.535291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ca6d0-b319-484c-a5d5-d982d2b4475e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:52.632551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ca6d0-b319-484c-a5d5-d982d2b4475e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:52.634316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ca6d0-b319-484c-a5d5-d982d2b4475e service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:52.680840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1052/2123] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:42:54.418206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6527a-aea9-4f4d-b933-bcad0389f0b4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:54.420236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6527a-aea9-4f4d-b933-bcad0389f0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:54.420812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6527a-aea9-4f4d-b933-bcad0389f0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:54.450892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-02f6527a-aea9-4f4d-b933-bcad0389f0b4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:54.452697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-02f6527a-aea9-4f4d-b933-bcad0389f0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:54.651779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1072/2124] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:54.729810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da0c4-0107-41c5-a4c5-90cfcd15890e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:54.730608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da0c4-0107-41c5-a4c5-90cfcd15890e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:54.730608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da0c4-0107-41c5-a4c5-90cfcd15890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:54.759197 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6527a-aea9-4f4d-b933-bcad0389f0b4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:54.762828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-02f6527a-aea9-4f4d-b933-bcad0389f0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:54.763582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-471da0c4-0107-41c5-a4c5-90cfcd15890e None None] MFA Rules not processed for user `66a5f1265c2f44fbb9a58d8d163b8460`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:54.765283 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-471da0c4-0107-41c5-a4c5-90cfcd15890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:54.899538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1053/2125] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:54.921149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6527a-aea9-4f4d-b933-bcad0389f0b4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:54.927826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fd7c0-dc19-4d99-a05e-3e24d6dbb3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:54.928657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fd7c0-dc19-4d99-a05e-3e24d6dbb3ff service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:54.929118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fd7c0-dc19-4d99-a05e-3e24d6dbb3ff service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:54.929387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fd7c0-dc19-4d99-a05e-3e24d6dbb3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:54.940419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fd7c0-dc19-4d99-a05e-3e24d6dbb3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:54.942200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fd7c0-dc19-4d99-a05e-3e24d6dbb3ff service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:54.965189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1073/2126] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:42:56.353468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471da0c4-0107-41c5-a4c5-90cfcd15890e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:56.371495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471da0c4-0107-41c5-a4c5-90cfcd15890e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:56.390513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:56.391550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:56.392046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:56.392652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] PATH_INFO: `/v3/users/743871ea8773433c9908ae2573f2618f` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:56.394414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=743871ea8773433c9908ae2573f2618f)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:56.396897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:56.479621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743871ea8773433c9908ae2573f2618f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:56.481575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743871ea8773433c9908ae2573f2618f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:56.502757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743871ea8773433c9908ae2573f2618f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:56.505778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:56.517845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743871ea8773433c9908ae2573f2618f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:56.521072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743871ea8773433c9908ae2573f2618f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:56.583794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1054/2127] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:56 2022] DELETE /identity/v3/users/743871ea8773433c9908ae2573f2618f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:56.598965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adeaba-028f-4dc7-896b-2056294416e0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:56.603336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adeaba-028f-4dc7-896b-2056294416e0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:56.603336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adeaba-028f-4dc7-896b-2056294416e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:56.645788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e3adeaba-028f-4dc7-896b-2056294416e0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:56.653276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e3adeaba-028f-4dc7-896b-2056294416e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:56.819835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:56.845283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1074/2128] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:56.866479 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:56.868029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:57.013444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad019-3477-41a4-b772-36db34f20b4e admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:57.025458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f18de9-18a1-4c42-be3b-e1ce96a7f4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:57.026384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f18de9-18a1-4c42-be3b-e1ce96a7f4fa service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:57.026763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f18de9-18a1-4c42-be3b-e1ce96a7f4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:57.027165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f18de9-18a1-4c42-be3b-e1ce96a7f4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:57.043010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f18de9-18a1-4c42-be3b-e1ce96a7f4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:57.044055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f18de9-18a1-4c42-be3b-e1ce96a7f4fa service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:57.063521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1055/2129] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:42:58.345627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adeaba-028f-4dc7-896b-2056294416e0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:58.348150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e3adeaba-028f-4dc7-896b-2056294416e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:58.384137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adeaba-028f-4dc7-896b-2056294416e0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:58.419020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:58.420078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:58.420588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:58.421058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] PATH_INFO: `/v3/projects/4e6ac1d431304ddda1d6f8591028debf` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:58.423982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6ac1d431304ddda1d6f8591028debf)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:58.430916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:58.550184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6ac1d431304ddda1d6f8591028debf', 'request_id': 'req-ffb7d667-65aa-4c39-a56e-2db224bc106e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:58.558054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6ac1d431304ddda1d6f8591028debf', 'request_id': 'req-ffb7d667-65aa-4c39-a56e-2db224bc106e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:58.570310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6ac1d431304ddda1d6f8591028debf', 'request_id': 'req-ffb7d667-65aa-4c39-a56e-2db224bc106e'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:58.591619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] The token cache is being invalidate because project 4e6ac1d431304ddda1d6f8591028debf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:42:58.592081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:58.593016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ffb7d667-65aa-4c39-a56e-2db224bc106e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:58.596922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1075/2130] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:58 2022] DELETE /identity/v3/projects/4e6ac1d431304ddda1d6f8591028debf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:58.601441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f18de9-18a1-4c42-be3b-e1ce96a7f4fa service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:58.628792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f18de9-18a1-4c42-be3b-e1ce96a7f4fa service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:42:58.754218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:42:58.755520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:58.755969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:58.756461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] PATH_INFO: `/v3/users/03fb91f223ad445c93518bf73e25f52e` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:58.758819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fb91f223ad445c93518bf73e25f52e)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:42:58.762344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:42:58.878564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fb91f223ad445c93518bf73e25f52e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:58.881642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fb91f223ad445c93518bf73e25f52e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:58.925911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fb91f223ad445c93518bf73e25f52e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:58.951048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fb91f223ad445c93518bf73e25f52e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:58.954179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fb91f223ad445c93518bf73e25f52e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:42:59.018108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1056/2131] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:42:58 2022] DELETE /identity/v3/users/03fb91f223ad445c93518bf73e25f52e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:42:59.790614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c136577-121a-479b-a4c4-016f34448d77 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:42:59.791863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c136577-121a-479b-a4c4-016f34448d77 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:42:59.793840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c136577-121a-479b-a4c4-016f34448d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:42:59.821754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1c136577-121a-479b-a4c4-016f34448d77 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:42:59.823475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1c136577-121a-479b-a4c4-016f34448d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:59.945988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1076/2132] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:42:59.963643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:59.966723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:59.982514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c136577-121a-479b-a4c4-016f34448d77 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:42:59.983220 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:42:59.985681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1c136577-121a-479b-a4c4-016f34448d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:42:59.993722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20793f2e-603a-4063-a498-211ca94a6c77 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:00.019705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:00.020659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:00.021144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:00.021650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] PATH_INFO: `/v3/projects/b862264eceea44159c6d03c9ffe49f5c` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:00.032173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b862264eceea44159c6d03c9ffe49f5c)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:00.035245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:00.131313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b862264eceea44159c6d03c9ffe49f5c', 'request_id': 'req-a9a4a5a1-d456-4238-abae-5b9a1b310553'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.154035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c136577-121a-479b-a4c4-016f34448d77 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:00.158385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b862264eceea44159c6d03c9ffe49f5c', 'request_id': 'req-a9a4a5a1-d456-4238-abae-5b9a1b310553'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.167918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b862264eceea44159c6d03c9ffe49f5c', 'request_id': 'req-a9a4a5a1-d456-4238-abae-5b9a1b310553'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.179248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:00.183161 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] The token cache is being invalidate because project b862264eceea44159c6d03c9ffe49f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:43:00.183492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.184257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.186112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1057/2133] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:42:59 2022] DELETE /identity/v3/projects/b862264eceea44159c6d03c9ffe49f5c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:00.190004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:00.192156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:00.274453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2394fe-7943-468d-9ffc-0ce82147a4b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:00.275418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2394fe-7943-468d-9ffc-0ce82147a4b2 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:00.275732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2394fe-7943-468d-9ffc-0ce82147a4b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:00.276136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2394fe-7943-468d-9ffc-0ce82147a4b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:00.278474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7a2394fe-7943-468d-9ffc-0ce82147a4b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:00.285415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4a5a1-d456-4238-abae-5b9a1b310553 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:00.293543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:00.293839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2394fe-7943-468d-9ffc-0ce82147a4b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:00.294858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:00.295391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:00.295938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] PATH_INFO: `/v3/users/037cb3d82eb14a7c8fccbdba28f0e333` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:00.296112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2394fe-7943-468d-9ffc-0ce82147a4b2 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:00.297877 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=037cb3d82eb14a7c8fccbdba28f0e333)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:00.301144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:00.327616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1077/2134] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:00.376625 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037cb3d82eb14a7c8fccbdba28f0e333'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.378059 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037cb3d82eb14a7c8fccbdba28f0e333'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.403512 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037cb3d82eb14a7c8fccbdba28f0e333'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.414845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037cb3d82eb14a7c8fccbdba28f0e333'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.415774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c1cabb5c-417f-422d-a25c-daeee135ac7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037cb3d82eb14a7c8fccbdba28f0e333'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:00.436682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1058/2135] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:43:00 2022] DELETE /identity/v3/users/037cb3d82eb14a7c8fccbdba28f0e333 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:43:00.826438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2394fe-7943-468d-9ffc-0ce82147a4b2 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:00.841734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2394fe-7943-468d-9ffc-0ce82147a4b2 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:00.989905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:00.991073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:00.991626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:00.991931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] PATH_INFO: `/v3/projects/59a277f795ce4d4b8d57276dc1111e60` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:00.993364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a277f795ce4d4b8d57276dc1111e60)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:00.996816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:01.086237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a277f795ce4d4b8d57276dc1111e60', 'request_id': 'req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:01.096822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a277f795ce4d4b8d57276dc1111e60', 'request_id': 'req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:01.112945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a277f795ce4d4b8d57276dc1111e60', 'request_id': 'req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:01.136658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] The token cache is being invalidate because project 59a277f795ce4d4b8d57276dc1111e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:43:01.137882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:01.138785 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8cd8d538-4bac-43af-adf1-25ba6c6f67ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:01.141061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1078/2136] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:43:00 2022] DELETE /identity/v3/projects/59a277f795ce4d4b8d57276dc1111e60 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:43:01.148154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d23b0-13ac-4bbf-9e61-daa50425b95c None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:01.149541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d23b0-13ac-4bbf-9e61-daa50425b95c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:01.150153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d23b0-13ac-4bbf-9e61-daa50425b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:01.203085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:01.214982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-904d23b0-13ac-4bbf-9e61-daa50425b95c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:01.214982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-904d23b0-13ac-4bbf-9e61-daa50425b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:01.339784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1059/2137] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:01.352690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21f445-cdea-4a01-9daf-4e374c2e7f27 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:01.353182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21f445-cdea-4a01-9daf-4e374c2e7f27 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:01.355295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21f445-cdea-4a01-9daf-4e374c2e7f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:01.392268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ae21f445-cdea-4a01-9daf-4e374c2e7f27 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:01.394595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ae21f445-cdea-4a01-9daf-4e374c2e7f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:01.420952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1079/2138] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:01.426612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d23b0-13ac-4bbf-9e61-daa50425b95c None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:01.441430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d23b0-13ac-4bbf-9e61-daa50425b95c None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:01.447703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e6cf3-6796-4c38-b06c-faa25ddba148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:01.448758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e6cf3-6796-4c38-b06c-faa25ddba148 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:01.449078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e6cf3-6796-4c38-b06c-faa25ddba148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:01.449407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e6cf3-6796-4c38-b06c-faa25ddba148 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:01.450255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e6cf3-6796-4c38-b06c-faa25ddba148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:43:01.450567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e6cf3-6796-4c38-b06c-faa25ddba148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:01.452393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e6cf3-6796-4c38-b06c-faa25ddba148 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:01.475445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1060/2139] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:43:01.481641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21f445-cdea-4a01-9daf-4e374c2e7f27 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:01.492180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21f445-cdea-4a01-9daf-4e374c2e7f27 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:01.497582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8a198-8cab-462c-a6e9-1928d187fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:01.498692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8a198-8cab-462c-a6e9-1928d187fd3c admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:01.498887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8a198-8cab-462c-a6e9-1928d187fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:01.499107 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8a198-8cab-462c-a6e9-1928d187fd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:01.502287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8a198-8cab-462c-a6e9-1928d187fd3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:01.502287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8a198-8cab-462c-a6e9-1928d187fd3c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:01.556154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1080/2140] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:43:01 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:01.561426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e6cf3-6796-4c38-b06c-faa25ddba148 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:01.573828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e6cf3-6796-4c38-b06c-faa25ddba148 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:01.730655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95860a4c-eaf0-47b5-8263-4741bbf49436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:01.731758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95860a4c-eaf0-47b5-8263-4741bbf49436 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:01.732256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95860a4c-eaf0-47b5-8263-4741bbf49436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:01.732797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95860a4c-eaf0-47b5-8263-4741bbf49436 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:01.740083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95860a4c-eaf0-47b5-8263-4741bbf49436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:01.742587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95860a4c-eaf0-47b5-8263-4741bbf49436 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:01.785259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1061/2141] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:43:01 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:01.792853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8a198-8cab-462c-a6e9-1928d187fd3c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:01.812517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:01.820527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8a198-8cab-462c-a6e9-1928d187fd3c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:01.829942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088733-f45e-4401-b7bc-9598debdad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:01.830901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088733-f45e-4401-b7bc-9598debdad1e admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:01.831272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088733-f45e-4401-b7bc-9598debdad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:01.831574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088733-f45e-4401-b7bc-9598debdad1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:01.832953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52088733-f45e-4401-b7bc-9598debdad1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:01.835302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52088733-f45e-4401-b7bc-9598debdad1e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:01.852950 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1081/2142] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:01.861015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95860a4c-eaf0-47b5-8263-4741bbf49436 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:01.887873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95860a4c-eaf0-47b5-8263-4741bbf49436 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:01.907354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb724a-de01-49e6-ac2b-48e589dc5251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:01.907354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb724a-de01-49e6-ac2b-48e589dc5251 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:01.907354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb724a-de01-49e6-ac2b-48e589dc5251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:01.907354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb724a-de01-49e6-ac2b-48e589dc5251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:01.907996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb724a-de01-49e6-ac2b-48e589dc5251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:01.911396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb724a-de01-49e6-ac2b-48e589dc5251 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:01.928095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1062/2143] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:43:01.934620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088733-f45e-4401-b7bc-9598debdad1e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:01.963143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088733-f45e-4401-b7bc-9598debdad1e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:01.972314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba91731-2311-4c42-a38a-a7ab54010888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:01.973529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91731-2311-4c42-a38a-a7ab54010888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:01.974137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91731-2311-4c42-a38a-a7ab54010888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:01.974524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba91731-2311-4c42-a38a-a7ab54010888 admin admin] PATH_INFO: `/v3/projects/13caa7c8e6e149e0ba98042820581768/users/f4e83697b94c4a04b39dd8cceebd49a0/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:01.999043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba91731-2311-4c42-a38a-a7ab54010888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13caa7c8e6e149e0ba98042820581768, user_id=f4e83697b94c4a04b39dd8cceebd49a0, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:02.003875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba91731-2311-4c42-a38a-a7ab54010888 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:02.026877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1082/2144] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:43:01 2022] PUT /identity/v3/projects/13caa7c8e6e149e0ba98042820581768/users/f4e83697b94c4a04b39dd8cceebd49a0/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:02.039945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae673dcf-7ad0-43c3-97a9-27d8fd71f069 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:02.040311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae673dcf-7ad0-43c3-97a9-27d8fd71f069 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:02.040684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae673dcf-7ad0-43c3-97a9-27d8fd71f069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:02.111344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ae673dcf-7ad0-43c3-97a9-27d8fd71f069 None None] MFA Rules not processed for user `f4e83697b94c4a04b39dd8cceebd49a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:02.114121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ae673dcf-7ad0-43c3-97a9-27d8fd71f069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:02.209070 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1063/2145] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:02.211096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba91731-2311-4c42-a38a-a7ab54010888 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:02.428216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba91731-2311-4c42-a38a-a7ab54010888 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:02.452274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aa992-bd36-4f04-86ac-0ad351cb4169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:02.452554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aa992-bd36-4f04-86ac-0ad351cb4169 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:02.452800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aa992-bd36-4f04-86ac-0ad351cb4169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:02.453107 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aa992-bd36-4f04-86ac-0ad351cb4169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:02.453837 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aa992-bd36-4f04-86ac-0ad351cb4169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:02.455826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aa992-bd36-4f04-86ac-0ad351cb4169 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:02.495911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1083/2146] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:43:02 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:02.501305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae673dcf-7ad0-43c3-97a9-27d8fd71f069 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:02.514882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:02.523601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae673dcf-7ad0-43c3-97a9-27d8fd71f069 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:02.609767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4795f8-4d2a-4aec-9e1f-d05f746da9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:02.610234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4795f8-4d2a-4aec-9e1f-d05f746da9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:02.610630 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4795f8-4d2a-4aec-9e1f-d05f746da9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:02.610990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4795f8-4d2a-4aec-9e1f-d05f746da9e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:02.611770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4795f8-4d2a-4aec-9e1f-d05f746da9e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:02.614884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4795f8-4d2a-4aec-9e1f-d05f746da9e0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:02.646777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1064/2147] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:43:02 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:02.649994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aa992-bd36-4f04-86ac-0ad351cb4169 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:02.660992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aa992-bd36-4f04-86ac-0ad351cb4169 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:02.665798 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23705fa6-82d4-4371-864d-e6e7445a7d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:02.666472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23705fa6-82d4-4371-864d-e6e7445a7d2e admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:02.666875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23705fa6-82d4-4371-864d-e6e7445a7d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:02.667049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23705fa6-82d4-4371-864d-e6e7445a7d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:02.667746 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23705fa6-82d4-4371-864d-e6e7445a7d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:02.669551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23705fa6-82d4-4371-864d-e6e7445a7d2e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:02.705198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1084/2148] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:02.711146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4795f8-4d2a-4aec-9e1f-d05f746da9e0 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:02.728536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4795f8-4d2a-4aec-9e1f-d05f746da9e0 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:02.736096 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52108cc8-596f-418d-8ccc-a77079aac492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:02.737204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52108cc8-596f-418d-8ccc-a77079aac492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:02.737622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52108cc8-596f-418d-8ccc-a77079aac492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:02.738038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52108cc8-596f-418d-8ccc-a77079aac492 admin admin] PATH_INFO: `/v3/projects/4de2e0c588114c7ca75c7685d921b90f/users/0433e94ba9564ec289bd70b918137260/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:02.767338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52108cc8-596f-418d-8ccc-a77079aac492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de2e0c588114c7ca75c7685d921b90f, user_id=0433e94ba9564ec289bd70b918137260, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:02.770074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52108cc8-596f-418d-8ccc-a77079aac492 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:02.792477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1065/2149] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:43:02 2022] PUT /identity/v3/projects/4de2e0c588114c7ca75c7685d921b90f/users/0433e94ba9564ec289bd70b918137260/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:02.793731 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23705fa6-82d4-4371-864d-e6e7445a7d2e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:02.810311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23705fa6-82d4-4371-864d-e6e7445a7d2e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:02.958149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3fbbc-7876-4ae9-86de-2237b3da4af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:02.959237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3fbbc-7876-4ae9-86de-2237b3da4af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:02.959846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3fbbc-7876-4ae9-86de-2237b3da4af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:02.960258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3fbbc-7876-4ae9-86de-2237b3da4af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:02.961109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3fbbc-7876-4ae9-86de-2237b3da4af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:02.964518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3fbbc-7876-4ae9-86de-2237b3da4af4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:02.981436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1085/2150] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:02.988084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52108cc8-596f-418d-8ccc-a77079aac492 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:03.004704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52108cc8-596f-418d-8ccc-a77079aac492 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:03.011610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156530d1-5fec-4f5d-91c4-7d9087c88ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:03.012278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156530d1-5fec-4f5d-91c4-7d9087c88ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:03.012558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156530d1-5fec-4f5d-91c4-7d9087c88ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:03.012833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156530d1-5fec-4f5d-91c4-7d9087c88ee6 admin admin] PATH_INFO: `/v3/projects/4de2e0c588114c7ca75c7685d921b90f/users/0433e94ba9564ec289bd70b918137260/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:03.015216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156530d1-5fec-4f5d-91c4-7d9087c88ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de2e0c588114c7ca75c7685d921b90f, user_id=0433e94ba9564ec289bd70b918137260, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:03.018470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156530d1-5fec-4f5d-91c4-7d9087c88ee6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:03.037436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1066/2151] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:43:02 2022] PUT /identity/v3/projects/4de2e0c588114c7ca75c7685d921b90f/users/0433e94ba9564ec289bd70b918137260/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:03.047838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59947608-78f5-4180-9eb0-703fb7711b8f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:03.048107 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59947608-78f5-4180-9eb0-703fb7711b8f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:03.048378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59947608-78f5-4180-9eb0-703fb7711b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:03.100137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-59947608-78f5-4180-9eb0-703fb7711b8f None None] MFA Rules not processed for user `0433e94ba9564ec289bd70b918137260`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:03.101215 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-59947608-78f5-4180-9eb0-703fb7711b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:03.155382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:03.220483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1086/2152] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:03.233753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156530d1-5fec-4f5d-91c4-7d9087c88ee6 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:03.235740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-156530d1-5fec-4f5d-91c4-7d9087c88ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:03.324275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156530d1-5fec-4f5d-91c4-7d9087c88ee6 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:03.328859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267efb07-2711-4d81-9e5b-0170f51ff45e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:03.329541 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267efb07-2711-4d81-9e5b-0170f51ff45e service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:03.329928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267efb07-2711-4d81-9e5b-0170f51ff45e service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:03.330250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267efb07-2711-4d81-9e5b-0170f51ff45e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:03.341617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267efb07-2711-4d81-9e5b-0170f51ff45e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:03.343093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267efb07-2711-4d81-9e5b-0170f51ff45e service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:03.354068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1067/2153] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:03.953508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59947608-78f5-4180-9eb0-703fb7711b8f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:03.955356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-59947608-78f5-4180-9eb0-703fb7711b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:04.066044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59947608-78f5-4180-9eb0-703fb7711b8f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:04.072740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:04.074820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:04.075342 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:04.075786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] PATH_INFO: `/v3/users/bc7c8d52d9314514b369e86ce0bdad72` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:04.077406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7c8d52d9314514b369e86ce0bdad72)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:04.085278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:04.153955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7c8d52d9314514b369e86ce0bdad72'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.173240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7c8d52d9314514b369e86ce0bdad72'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.174179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7c8d52d9314514b369e86ce0bdad72'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.187369 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7c8d52d9314514b369e86ce0bdad72'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.188506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7c8d52d9314514b369e86ce0bdad72'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.251003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1087/2154] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:43:03 2022] DELETE /identity/v3/users/bc7c8d52d9314514b369e86ce0bdad72 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:04.254579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1abdb-2373-4a29-9fa5-d35151b0550e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:04.255573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1abdb-2373-4a29-9fa5-d35151b0550e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:04.256599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1abdb-2373-4a29-9fa5-d35151b0550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:04.294037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-9ef1abdb-2373-4a29-9fa5-d35151b0550e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:04.297188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9ef1abdb-2373-4a29-9fa5-d35151b0550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:04.392265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:04.394178 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:04.468842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:04.488548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:04.508941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1068/2155] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:04.518616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d41a6-1b59-4baa-b08f-b3371e578278 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:04.520903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1abdb-2373-4a29-9fa5-d35151b0550e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:04.524125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-9ef1abdb-2373-4a29-9fa5-d35151b0550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:04.530584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:04.532281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:04.533141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:04.533762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] PATH_INFO: `/v3/users/f4e83697b94c4a04b39dd8cceebd49a0` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:04.536429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e83697b94c4a04b39dd8cceebd49a0)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:04.541793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:04.623789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e83697b94c4a04b39dd8cceebd49a0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.645925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e83697b94c4a04b39dd8cceebd49a0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.647410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e83697b94c4a04b39dd8cceebd49a0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.665450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e83697b94c4a04b39dd8cceebd49a0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.666911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-feeacf85-a401-45e5-a96b-e2d1ce724cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e83697b94c4a04b39dd8cceebd49a0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:04.690723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1088/2156] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:43:04 2022] DELETE /identity/v3/users/f4e83697b94c4a04b39dd8cceebd49a0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:43:04.694066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883ade3-27cc-4201-bec9-500a369df806 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:04.694564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883ade3-27cc-4201-bec9-500a369df806 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:04.694869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883ade3-27cc-4201-bec9-500a369df806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:04.729384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1abdb-2373-4a29-9fa5-d35151b0550e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:04.736044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e883ade3-27cc-4201-bec9-500a369df806 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:04.737380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e883ade3-27cc-4201-bec9-500a369df806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:04.829769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:04.831027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:04.831651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:04.832061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:04.835157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:04.859910 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1089/2157] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:04.876490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883ade3-27cc-4201-bec9-500a369df806 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:04.878671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e883ade3-27cc-4201-bec9-500a369df806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:04.896015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883ade3-27cc-4201-bec9-500a369df806 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:04.909751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de108443-b87f-4331-8e22-a981370552d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:04.910710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de108443-b87f-4331-8e22-a981370552d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:04.911030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de108443-b87f-4331-8e22-a981370552d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:04.911334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de108443-b87f-4331-8e22-a981370552d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:04.935290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de108443-b87f-4331-8e22-a981370552d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:04.942483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de108443-b87f-4331-8e22-a981370552d6 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:04.964165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:04.967386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:04.968179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1090/2158] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:04.981632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1069/2159] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:05.790803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de108443-b87f-4331-8e22-a981370552d6 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:05.794789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-de108443-b87f-4331-8e22-a981370552d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:05.813321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de108443-b87f-4331-8e22-a981370552d6 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:05.820892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:05.821544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:05.822177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:05.822615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] PATH_INFO: `/v3/projects/4d24537319d74da9bbd8a80d5b822865` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:05.827197 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d24537319d74da9bbd8a80d5b822865)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:05.834862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:05.991088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:06.003581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d24537319d74da9bbd8a80d5b822865', 'request_id': 'req-c04b91a5-7bd0-48db-860a-59f108f5ee58'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.017393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d24537319d74da9bbd8a80d5b822865', 'request_id': 'req-c04b91a5-7bd0-48db-860a-59f108f5ee58'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.032122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d24537319d74da9bbd8a80d5b822865', 'request_id': 'req-c04b91a5-7bd0-48db-860a-59f108f5ee58'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.052411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] The token cache is being invalidate because project 4d24537319d74da9bbd8a80d5b822865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:43:06.053124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.054497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c04b91a5-7bd0-48db-860a-59f108f5ee58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.067443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1091/2160] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:43:05 2022] DELETE /identity/v3/projects/4d24537319d74da9bbd8a80d5b822865 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:06.068921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:06.072206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:06.075807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5605ef7-dc83-4b36-b59a-ca33e397a65c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:06.076216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5605ef7-dc83-4b36-b59a-ca33e397a65c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:06.079534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5605ef7-dc83-4b36-b59a-ca33e397a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:06.112675 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea97d83-2b79-476f-b30b-1f0b73b13453 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:06.150549 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c5605ef7-dc83-4b36-b59a-ca33e397a65c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:06.162727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c5605ef7-dc83-4b36-b59a-ca33e397a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:06.360554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:06.362447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:06.363386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:06.363895 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] PATH_INFO: `/v3/projects/13caa7c8e6e149e0ba98042820581768` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:06.365608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=13caa7c8e6e149e0ba98042820581768)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:06.367121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1092/2161] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:06.368407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:06.368826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fedcb-07b2-4388-b5d5-e35452040775 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:06.369121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fedcb-07b2-4388-b5d5-e35452040775 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:06.369390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fedcb-07b2-4388-b5d5-e35452040775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:06.378473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:06.396186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c62fedcb-07b2-4388-b5d5-e35452040775 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:06.397586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c62fedcb-07b2-4388-b5d5-e35452040775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:06.429470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1093/2162] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:06.431754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fedcb-07b2-4388-b5d5-e35452040775 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:06.445223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fedcb-07b2-4388-b5d5-e35452040775 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:06.489082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13caa7c8e6e149e0ba98042820581768', 'request_id': 'req-57d219b5-807a-4770-84d1-56a9bb68b11c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.505409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13caa7c8e6e149e0ba98042820581768', 'request_id': 'req-57d219b5-807a-4770-84d1-56a9bb68b11c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.531986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13caa7c8e6e149e0ba98042820581768', 'request_id': 'req-57d219b5-807a-4770-84d1-56a9bb68b11c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.542738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:06.544223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:06.544520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:06.544787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:06.546297 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:43:06.546610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:06.548456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:06.570699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1094/2163] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:43:06.570978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] The token cache is being invalidate because project 13caa7c8e6e149e0ba98042820581768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:43:06.570978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.570978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.572028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1070/2164] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:43:06 2022] DELETE /identity/v3/projects/13caa7c8e6e149e0ba98042820581768 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:43:06.576627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:06.577662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:06.580111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:06.583270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:06.605928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d219b5-807a-4770-84d1-56a9bb68b11c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:06.607202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d95b4-e346-4aed-b20e-429fb642ae63 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:06.614627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0c62a-8409-447d-9a2c-7034f0dec474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:06.615336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c62a-8409-447d-9a2c-7034f0dec474 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:06.615619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c62a-8409-447d-9a2c-7034f0dec474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:06.616054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0c62a-8409-447d-9a2c-7034f0dec474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:06.617057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0c62a-8409-447d-9a2c-7034f0dec474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:06.621443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0c62a-8409-447d-9a2c-7034f0dec474 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:06.623771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:06.624433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:06.624715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:06.626071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] PATH_INFO: `/v3/users/0433e94ba9564ec289bd70b918137260` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:06.627756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0433e94ba9564ec289bd70b918137260)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:06.630476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:06.691616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1095/2165] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:43:06 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:06.692968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c22d9f-b67a-47b6-9569-03318bb22072 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:06.694153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c22d9f-b67a-47b6-9569-03318bb22072 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:06.694153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c22d9f-b67a-47b6-9569-03318bb22072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:06.742566 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0433e94ba9564ec289bd70b918137260'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.747058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0433e94ba9564ec289bd70b918137260'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.752277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f0c22d9f-b67a-47b6-9569-03318bb22072 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:06.753597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f0c22d9f-b67a-47b6-9569-03318bb22072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:06.775204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0433e94ba9564ec289bd70b918137260'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.794916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0433e94ba9564ec289bd70b918137260'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.795840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0433e94ba9564ec289bd70b918137260'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:06.830100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1071/2166] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:43:06 2022] DELETE /identity/v3/users/0433e94ba9564ec289bd70b918137260 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:06.830515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:06.833640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:06.850479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:06.942849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1096/2167] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:07.015522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f29f2b-13cd-46c2-a974-9e5e4c5b753e admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:07.021438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c57d9b-8c99-44ed-82ca-490f170ce4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:07.022873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c57d9b-8c99-44ed-82ca-490f170ce4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:07.023237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c57d9b-8c99-44ed-82ca-490f170ce4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:07.023786 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c57d9b-8c99-44ed-82ca-490f170ce4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:07.024785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c57d9b-8c99-44ed-82ca-490f170ce4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:07.027734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c57d9b-8c99-44ed-82ca-490f170ce4c4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:07.045653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:07.075249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1072/2168] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:43:06 2022] POST /identity/v3/users => generated 288 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:07.077682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c22d9f-b67a-47b6-9569-03318bb22072 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:07.092679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c22d9f-b67a-47b6-9569-03318bb22072 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:07.107532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b96e4-48b7-4431-80b9-2c5becbd151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:07.109392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b96e4-48b7-4431-80b9-2c5becbd151b admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:07.111123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b96e4-48b7-4431-80b9-2c5becbd151b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:07.112918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b96e4-48b7-4431-80b9-2c5becbd151b admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:07.114061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df86fc-3701-4d51-8c4c-2e0e029cae46 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:07.116519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b96e4-48b7-4431-80b9-2c5becbd151b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:07.117163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df86fc-3701-4d51-8c4c-2e0e029cae46 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:07.118371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df86fc-3701-4d51-8c4c-2e0e029cae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:07.121030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b96e4-48b7-4431-80b9-2c5becbd151b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:07.158064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-85df86fc-3701-4d51-8c4c-2e0e029cae46 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:07.160240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1097/2169] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:07.161031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b96e4-48b7-4431-80b9-2c5becbd151b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:07.170503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-85df86fc-3701-4d51-8c4c-2e0e029cae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:07.174167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b96e4-48b7-4431-80b9-2c5becbd151b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:07.179803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951602c-2148-48ee-83c4-8dc5f0ebfe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:07.180630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951602c-2148-48ee-83c4-8dc5f0ebfe16 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:07.180974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951602c-2148-48ee-83c4-8dc5f0ebfe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:07.181254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951602c-2148-48ee-83c4-8dc5f0ebfe16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:07.181930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951602c-2148-48ee-83c4-8dc5f0ebfe16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:07.184248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951602c-2148-48ee-83c4-8dc5f0ebfe16 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:07.214354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1098/2170] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:07.216563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951602c-2148-48ee-83c4-8dc5f0ebfe16 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:07.235231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951602c-2148-48ee-83c4-8dc5f0ebfe16 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:07.241259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aab80a-999c-4dda-8adf-c6170a1591db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:07.242067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab80a-999c-4dda-8adf-c6170a1591db admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:07.242489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab80a-999c-4dda-8adf-c6170a1591db admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:07.242802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab80a-999c-4dda-8adf-c6170a1591db admin admin] PATH_INFO: `/v3/projects/84e839c59f3a4d8c8dcb58b5d4c15b13/users/0fb553061fdd40659ba0495b002c7498/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:07.265477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aab80a-999c-4dda-8adf-c6170a1591db admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e839c59f3a4d8c8dcb58b5d4c15b13, user_id=0fb553061fdd40659ba0495b002c7498, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:07.270594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aab80a-999c-4dda-8adf-c6170a1591db admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:07.298869 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1099/2171] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:43:07 2022] PUT /identity/v3/projects/84e839c59f3a4d8c8dcb58b5d4c15b13/users/0fb553061fdd40659ba0495b002c7498/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:07.314676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68e952-ba2f-4527-82ec-4c0561ec08f8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:07.315545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68e952-ba2f-4527-82ec-4c0561ec08f8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:07.315834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68e952-ba2f-4527-82ec-4c0561ec08f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:07.403220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9a68e952-ba2f-4527-82ec-4c0561ec08f8 None None] MFA Rules not processed for user `0fb553061fdd40659ba0495b002c7498`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:07.407584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9a68e952-ba2f-4527-82ec-4c0561ec08f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:07.413796 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1073/2172] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:43:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:07.507792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df86fc-3701-4d51-8c4c-2e0e029cae46 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:07.510068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-85df86fc-3701-4d51-8c4c-2e0e029cae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:07.513961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1100/2173] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:07.519368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68e952-ba2f-4527-82ec-4c0561ec08f8 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:07.635654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68e952-ba2f-4527-82ec-4c0561ec08f8 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:07.642343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d057c-77ab-47a3-8478-7a1fc8aa92ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:07.643065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d057c-77ab-47a3-8478-7a1fc8aa92ca admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:07.643386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d057c-77ab-47a3-8478-7a1fc8aa92ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:07.643719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d057c-77ab-47a3-8478-7a1fc8aa92ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:07.644404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d057c-77ab-47a3-8478-7a1fc8aa92ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:07.649496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d057c-77ab-47a3-8478-7a1fc8aa92ca admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:07.707846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1101/2174] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:43:07 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:43:07.722614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d057c-77ab-47a3-8478-7a1fc8aa92ca admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:07.733191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df86fc-3701-4d51-8c4c-2e0e029cae46 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:07.743523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:07.891787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3757-d3db-4fa5-88e1-e85f22ea8fb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:07.892532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3757-d3db-4fa5-88e1-e85f22ea8fb5 service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:07.892810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3757-d3db-4fa5-88e1-e85f22ea8fb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:07.893184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3757-d3db-4fa5-88e1-e85f22ea8fb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:07.902459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d057c-77ab-47a3-8478-7a1fc8aa92ca admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:07.912694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0fe5c-02ea-437c-8093-362cf07b5b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:07.913949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0fe5c-02ea-437c-8093-362cf07b5b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:07.914247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0fe5c-02ea-437c-8093-362cf07b5b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:07.914523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0fe5c-02ea-437c-8093-362cf07b5b0e admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:07.915527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0fe5c-02ea-437c-8093-362cf07b5b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:07.918422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0fe5c-02ea-437c-8093-362cf07b5b0e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:07.961582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1102/2175] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:43:07 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:07.962644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0fe5c-02ea-437c-8093-362cf07b5b0e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:07.980816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0fe5c-02ea-437c-8093-362cf07b5b0e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:07.983724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:07.999169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd95d41-7733-4b75-8ae5-3afdfea6bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:08.000069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd95d41-7733-4b75-8ae5-3afdfea6bc46 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:08.000220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd95d41-7733-4b75-8ae5-3afdfea6bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:08.000485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd95d41-7733-4b75-8ae5-3afdfea6bc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:08.002457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd95d41-7733-4b75-8ae5-3afdfea6bc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:08.004266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd95d41-7733-4b75-8ae5-3afdfea6bc46 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:08.013177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba3757-d3db-4fa5-88e1-e85f22ea8fb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:08.015697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba3757-d3db-4fa5-88e1-e85f22ea8fb5 service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:08.029531 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1103/2176] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:08.030900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd95d41-7733-4b75-8ae5-3afdfea6bc46 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:08.047823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd95d41-7733-4b75-8ae5-3afdfea6bc46 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:08.056150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1074/2177] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:43:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:43:08.057256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859be8c8-b6c7-4a81-8c65-d593ef981648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:08.059079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859be8c8-b6c7-4a81-8c65-d593ef981648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:08.059442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859be8c8-b6c7-4a81-8c65-d593ef981648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:08.059968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859be8c8-b6c7-4a81-8c65-d593ef981648 admin admin] PATH_INFO: `/v3/projects/00fd2b0dcc0e49d6bd1321cbcb832b9e/users/e8374c097ed7400eaead0f27e12e5bc0/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:08.080577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859be8c8-b6c7-4a81-8c65-d593ef981648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fd2b0dcc0e49d6bd1321cbcb832b9e, user_id=e8374c097ed7400eaead0f27e12e5bc0, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:08.085330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859be8c8-b6c7-4a81-8c65-d593ef981648 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:08.137371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1104/2178] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:43:08 2022] PUT /identity/v3/projects/00fd2b0dcc0e49d6bd1321cbcb832b9e/users/e8374c097ed7400eaead0f27e12e5bc0/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:08.138279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3757-d3db-4fa5-88e1-e85f22ea8fb5 service swift] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:08.162788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859be8c8-b6c7-4a81-8c65-d593ef981648 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:08.175894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3757-d3db-4fa5-88e1-e85f22ea8fb5 service swift] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:08.177894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-859be8c8-b6c7-4a81-8c65-d593ef981648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:08.295733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859be8c8-b6c7-4a81-8c65-d593ef981648 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:08.299668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204df776-2485-4daa-b7cd-12bd4da90edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:08.300303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204df776-2485-4daa-b7cd-12bd4da90edf admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:08.300585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204df776-2485-4daa-b7cd-12bd4da90edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:08.304410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204df776-2485-4daa-b7cd-12bd4da90edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:08.305735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204df776-2485-4daa-b7cd-12bd4da90edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:08.310478 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204df776-2485-4daa-b7cd-12bd4da90edf admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:08.310952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4301e79-3548-48ec-b3c4-84f4eb93b9c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:08.312014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301e79-3548-48ec-b3c4-84f4eb93b9c8 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:08.312422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301e79-3548-48ec-b3c4-84f4eb93b9c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:08.312916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301e79-3548-48ec-b3c4-84f4eb93b9c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:08.325379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1075/2179] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:08.329907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204df776-2485-4daa-b7cd-12bd4da90edf admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:08.335973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4301e79-3548-48ec-b3c4-84f4eb93b9c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:08.341732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4301e79-3548-48ec-b3c4-84f4eb93b9c8 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:08.367568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204df776-2485-4daa-b7cd-12bd4da90edf admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:08.371444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1105/2180] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:08.395826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770840a-3358-4310-821e-872ac30cfea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:08.396843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770840a-3358-4310-821e-872ac30cfea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:08.397632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770840a-3358-4310-821e-872ac30cfea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:08.398155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770840a-3358-4310-821e-872ac30cfea7 admin admin] PATH_INFO: `/v3/projects/00fd2b0dcc0e49d6bd1321cbcb832b9e/users/e8374c097ed7400eaead0f27e12e5bc0/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:08.404496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770840a-3358-4310-821e-872ac30cfea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fd2b0dcc0e49d6bd1321cbcb832b9e, user_id=e8374c097ed7400eaead0f27e12e5bc0, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:08.409415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770840a-3358-4310-821e-872ac30cfea7 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:08.432520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1076/2181] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:43:08 2022] PUT /identity/v3/projects/00fd2b0dcc0e49d6bd1321cbcb832b9e/users/e8374c097ed7400eaead0f27e12e5bc0/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:08.443465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c4ed6-3f4a-4397-8971-f7365e9019b9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:08.445543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c4ed6-3f4a-4397-8971-f7365e9019b9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:08.447669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c4ed6-3f4a-4397-8971-f7365e9019b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:08.531756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-af7c4ed6-3f4a-4397-8971-f7365e9019b9 None None] MFA Rules not processed for user `e8374c097ed7400eaead0f27e12e5bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:08.537146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-af7c4ed6-3f4a-4397-8971-f7365e9019b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:08.619512 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770840a-3358-4310-821e-872ac30cfea7 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:08.628731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1770840a-3358-4310-821e-872ac30cfea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:08.724094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:08.815784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1106/2182] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:43:08.856969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c4ed6-3f4a-4397-8971-f7365e9019b9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:08.861120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-af7c4ed6-3f4a-4397-8971-f7365e9019b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:08.889000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770840a-3358-4310-821e-872ac30cfea7 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:08.897880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:08.898955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:08.899238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:08.899718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] PATH_INFO: `/v3/projects/4de2e0c588114c7ca75c7685d921b90f` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:08.902205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de2e0c588114c7ca75c7685d921b90f)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:08.910187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:08.988579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c4ed6-3f4a-4397-8971-f7365e9019b9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:09.023700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de2e0c588114c7ca75c7685d921b90f', 'request_id': 'req-b247b249-029e-42fe-9f28-f099aecd4e6e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:09.047543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de2e0c588114c7ca75c7685d921b90f', 'request_id': 'req-b247b249-029e-42fe-9f28-f099aecd4e6e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:09.063877 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de2e0c588114c7ca75c7685d921b90f', 'request_id': 'req-b247b249-029e-42fe-9f28-f099aecd4e6e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:09.081231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:09.090103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] The token cache is being invalidate because project 4de2e0c588114c7ca75c7685d921b90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:43:09.090390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060b1da-d3d6-4bce-bee2-789087b62de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:09.091096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060b1da-d3d6-4bce-bee2-789087b62de3 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:09.091379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060b1da-d3d6-4bce-bee2-789087b62de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:09.091652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060b1da-d3d6-4bce-bee2-789087b62de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:09.091936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:09.093957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b247b249-029e-42fe-9f28-f099aecd4e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:09.097095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1077/2183] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:43:08 2022] DELETE /identity/v3/projects/4de2e0c588114c7ca75c7685d921b90f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:43:09.106568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7814-a02f-4018-934c-963792e489d8 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:09.107536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7814-a02f-4018-934c-963792e489d8 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:09.108169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa7814-a02f-4018-934c-963792e489d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:09.186923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-24aa7814-a02f-4018-934c-963792e489d8 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:09.187578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-24aa7814-a02f-4018-934c-963792e489d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:09.208018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060b1da-d3d6-4bce-bee2-789087b62de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:09.221015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060b1da-d3d6-4bce-bee2-789087b62de3 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:09.235429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1107/2184] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:09.330246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1078/2185] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:09.339413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ac1f-1c3d-4a9a-b831-859c2252171a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:09.339816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ac1f-1c3d-4a9a-b831-859c2252171a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:09.340083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ac1f-1c3d-4a9a-b831-859c2252171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:09.369680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f361ac1f-1c3d-4a9a-b831-859c2252171a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:09.370755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f361ac1f-1c3d-4a9a-b831-859c2252171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:09.382504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1108/2186] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:43:09.390954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7814-a02f-4018-934c-963792e489d8 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:09.432216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa7814-a02f-4018-934c-963792e489d8 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:09.441247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12401adb-f7d4-4171-990f-7cf039f9f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:09.441892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401adb-f7d4-4171-990f-7cf039f9f2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:09.442279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401adb-f7d4-4171-990f-7cf039f9f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:09.442624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401adb-f7d4-4171-990f-7cf039f9f2a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:09.443383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12401adb-f7d4-4171-990f-7cf039f9f2a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:43:09.443705 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12401adb-f7d4-4171-990f-7cf039f9f2a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:09.445489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12401adb-f7d4-4171-990f-7cf039f9f2a1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:09.492993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1079/2187] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:43:09.497526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361ac1f-1c3d-4a9a-b831-859c2252171a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:09.508993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361ac1f-1c3d-4a9a-b831-859c2252171a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:09.525815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcb92f-9b87-4ecf-8d39-c033c9035347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:09.528221 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcb92f-9b87-4ecf-8d39-c033c9035347 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:09.528386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcb92f-9b87-4ecf-8d39-c033c9035347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:09.528813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcb92f-9b87-4ecf-8d39-c033c9035347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:09.529937 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcb92f-9b87-4ecf-8d39-c033c9035347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:09.544005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcb92f-9b87-4ecf-8d39-c033c9035347 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:09.645909 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1109/2188] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:43:09 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:09.650666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12401adb-f7d4-4171-990f-7cf039f9f2a1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:09.689071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12401adb-f7d4-4171-990f-7cf039f9f2a1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:09.867844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d77a9e-fd49-45bb-88fe-4de9996a9cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:09.869879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d77a9e-fd49-45bb-88fe-4de9996a9cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:09.870847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d77a9e-fd49-45bb-88fe-4de9996a9cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:09.871156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d77a9e-fd49-45bb-88fe-4de9996a9cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:09.874446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d77a9e-fd49-45bb-88fe-4de9996a9cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:09.883633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d77a9e-fd49-45bb-88fe-4de9996a9cd9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:09.993391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1080/2189] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:43:09 2022] POST /identity/v3/users => generated 285 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:09.994401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcb92f-9b87-4ecf-8d39-c033c9035347 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:10.019296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcb92f-9b87-4ecf-8d39-c033c9035347 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:10.051104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adbf72-abc4-4f97-97e8-85b539a882dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:10.053262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adbf72-abc4-4f97-97e8-85b539a882dd admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:10.053842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adbf72-abc4-4f97-97e8-85b539a882dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:10.054238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adbf72-abc4-4f97-97e8-85b539a882dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:10.055906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adbf72-abc4-4f97-97e8-85b539a882dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:10.060078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adbf72-abc4-4f97-97e8-85b539a882dd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:10.080243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d77a9e-fd49-45bb-88fe-4de9996a9cd9 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:10.091222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1110/2190] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:10.098175 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d77a9e-fd49-45bb-88fe-4de9996a9cd9 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:10.105245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea06d13-e155-445b-a1a7-e6c37268cae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:10.106087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea06d13-e155-445b-a1a7-e6c37268cae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:10.106441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea06d13-e155-445b-a1a7-e6c37268cae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:10.107016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea06d13-e155-445b-a1a7-e6c37268cae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:10.107905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea06d13-e155-445b-a1a7-e6c37268cae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:10.110328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea06d13-e155-445b-a1a7-e6c37268cae9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:10.131473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adbf72-abc4-4f97-97e8-85b539a882dd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:10.135018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1081/2191] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:10.141407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:10.147704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adbf72-abc4-4f97-97e8-85b539a882dd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:10.155684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72f6cb-9428-4f33-aea2-be0ae8804865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:10.156885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72f6cb-9428-4f33-aea2-be0ae8804865 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:10.157235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72f6cb-9428-4f33-aea2-be0ae8804865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:10.157978 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72f6cb-9428-4f33-aea2-be0ae8804865 admin admin] PATH_INFO: `/v3/projects/733377943b2e4b8289a49f9462c6bd50/users/7f907b01e7a944039259e2333a8578c6/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:10.180893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72f6cb-9428-4f33-aea2-be0ae8804865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733377943b2e4b8289a49f9462c6bd50, user_id=7f907b01e7a944039259e2333a8578c6, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:10.184708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72f6cb-9428-4f33-aea2-be0ae8804865 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:10.212329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1111/2192] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:43:10 2022] PUT /identity/v3/projects/733377943b2e4b8289a49f9462c6bd50/users/7f907b01e7a944039259e2333a8578c6/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:43:10.225010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39c405-5708-460c-bae6-d4d2a414a2bd None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:10.225744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39c405-5708-460c-bae6-d4d2a414a2bd None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:10.225942 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39c405-5708-460c-bae6-d4d2a414a2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:10.281855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ad39c405-5708-460c-bae6-d4d2a414a2bd None None] MFA Rules not processed for user `7f907b01e7a944039259e2333a8578c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:10.283236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ad39c405-5708-460c-bae6-d4d2a414a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:10.379453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:10.396002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1082/2193] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:10.410111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72f6cb-9428-4f33-aea2-be0ae8804865 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:10.411996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4f72f6cb-9428-4f33-aea2-be0ae8804865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:10.524962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72f6cb-9428-4f33-aea2-be0ae8804865 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:10.532034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209a101-7580-455a-8335-4c548dbd3838 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d055337c9a642bd9b8b5a60aacb11cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:10.532790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209a101-7580-455a-8335-4c548dbd3838 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:10.533191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209a101-7580-455a-8335-4c548dbd3838 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:10.533532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209a101-7580-455a-8335-4c548dbd3838 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:10.555743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209a101-7580-455a-8335-4c548dbd3838 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:10.557522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209a101-7580-455a-8335-4c548dbd3838 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:10.579088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1112/2194] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:12.219631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4123d-f6da-4996-80f8-2f05a91abdc4 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:12.220899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4123d-f6da-4996-80f8-2f05a91abdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:12.221193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4123d-f6da-4996-80f8-2f05a91abdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:12.267903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b6f4123d-f6da-4996-80f8-2f05a91abdc4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:12.270082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b6f4123d-f6da-4996-80f8-2f05a91abdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:12.388735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1083/2195] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:12.477742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209a101-7580-455a-8335-4c548dbd3838 service glance] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:12.480489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3209a101-7580-455a-8335-4c548dbd3838 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:12.592955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209a101-7580-455a-8335-4c548dbd3838 service glance] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:12.605340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ed642-f86d-44d8-9f25-7e1fa810c4d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:12.605947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4123d-f6da-4996-80f8-2f05a91abdc4 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:12.606418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ed642-f86d-44d8-9f25-7e1fa810c4d0 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:12.606870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ed642-f86d-44d8-9f25-7e1fa810c4d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:12.607790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ed642-f86d-44d8-9f25-7e1fa810c4d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:12.610159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b6f4123d-f6da-4996-80f8-2f05a91abdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:12.622723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ed642-f86d-44d8-9f25-7e1fa810c4d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:12.624596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ed642-f86d-44d8-9f25-7e1fa810c4d0 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:12.652341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1113/2196] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:12.659204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4123d-f6da-4996-80f8-2f05a91abdc4 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:12.664912 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:12.665908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:12.666301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:12.666719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] PATH_INFO: `/v3/users/0fb553061fdd40659ba0495b002c7498` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:12.668545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb553061fdd40659ba0495b002c7498)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:12.670839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:12.737968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb553061fdd40659ba0495b002c7498'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:12.738741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb553061fdd40659ba0495b002c7498'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:12.757331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb553061fdd40659ba0495b002c7498'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:12.787735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb553061fdd40659ba0495b002c7498'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:12.788979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb553061fdd40659ba0495b002c7498'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:12.836108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1084/2197] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:43:12 2022] DELETE /identity/v3/users/0fb553061fdd40659ba0495b002c7498 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:12.849892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4a5f-3017-40cf-8117-fda749225c83 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:12.850642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4a5f-3017-40cf-8117-fda749225c83 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:12.852771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4a5f-3017-40cf-8117-fda749225c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:12.885059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1f1f4a5f-3017-40cf-8117-fda749225c83 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:12.886623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1f1f4a5f-3017-40cf-8117-fda749225c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:13.006811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1114/2198] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:13.018523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:13.020079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:13.126287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92506f-53cb-4254-8492-c8267d482393 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:13.166115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17e701-2812-4da2-a4d8-de5353eaec92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:13.167163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e701-2812-4da2-a4d8-de5353eaec92 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:13.167679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e701-2812-4da2-a4d8-de5353eaec92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:13.168162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17e701-2812-4da2-a4d8-de5353eaec92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:13.199288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17e701-2812-4da2-a4d8-de5353eaec92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:13.200738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17e701-2812-4da2-a4d8-de5353eaec92 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:13.220911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1085/2199] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:43:13.885766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4a5f-3017-40cf-8117-fda749225c83 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:13.923395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1f1f4a5f-3017-40cf-8117-fda749225c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:13.988867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:14.064362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17e701-2812-4da2-a4d8-de5353eaec92 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:14.067204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3f17e701-2812-4da2-a4d8-de5353eaec92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:14.116699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17e701-2812-4da2-a4d8-de5353eaec92 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:14.127654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:14.133031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:14.133596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:14.133980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] PATH_INFO: `/v3/projects/84e839c59f3a4d8c8dcb58b5d4c15b13` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:14.135891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e839c59f3a4d8c8dcb58b5d4c15b13)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:14.137981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:14.140870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:14.152666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4a5f-3017-40cf-8117-fda749225c83 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:14.164842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433d1a4-d588-48ec-ac46-87b492e86771 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:14.165877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433d1a4-d588-48ec-ac46-87b492e86771 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:14.166168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433d1a4-d588-48ec-ac46-87b492e86771 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:14.166456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433d1a4-d588-48ec-ac46-87b492e86771 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:14.168946 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f433d1a4-d588-48ec-ac46-87b492e86771 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:14.184169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433d1a4-d588-48ec-ac46-87b492e86771 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:14.186448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433d1a4-d588-48ec-ac46-87b492e86771 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:14.228392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e839c59f3a4d8c8dcb58b5d4c15b13', 'request_id': 'req-3231bc27-9e70-483a-9078-558a6831d602'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.242571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1115/2200] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:14.261094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e839c59f3a4d8c8dcb58b5d4c15b13', 'request_id': 'req-3231bc27-9e70-483a-9078-558a6831d602'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.269137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e839c59f3a4d8c8dcb58b5d4c15b13', 'request_id': 'req-3231bc27-9e70-483a-9078-558a6831d602'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.286374 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] The token cache is being invalidate because project 84e839c59f3a4d8c8dcb58b5d4c15b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:43:14.286966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.288138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.290489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1086/2201] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:43:14 2022] DELETE /identity/v3/projects/84e839c59f3a4d8c8dcb58b5d4c15b13 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:43:14.296065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433d1a4-d588-48ec-ac46-87b492e86771 service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:14.311328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433d1a4-d588-48ec-ac46-87b492e86771 service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:14.412931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:14.414471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:14.414878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:14.415648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] PATH_INFO: `/v3/users/e8374c097ed7400eaead0f27e12e5bc0` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:14.417831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8374c097ed7400eaead0f27e12e5bc0)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:14.422395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:14.574727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8374c097ed7400eaead0f27e12e5bc0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.634618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8374c097ed7400eaead0f27e12e5bc0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.636695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8374c097ed7400eaead0f27e12e5bc0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.694266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8374c097ed7400eaead0f27e12e5bc0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.697838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8374c097ed7400eaead0f27e12e5bc0'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:14.739319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1116/2202] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:43:14 2022] DELETE /identity/v3/users/e8374c097ed7400eaead0f27e12e5bc0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:15.563905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:15.565713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:15.684201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:15.686245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:15.696090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231bc27-9e70-483a-9078-558a6831d602 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:15.743447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:15.791290 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5808-bf36-4d6e-9f66-5efd1e834ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:15.798686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5808-bf36-4d6e-9f66-5efd1e834ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:15.798686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5808-bf36-4d6e-9f66-5efd1e834ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:15.798686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5808-bf36-4d6e-9f66-5efd1e834ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:15.801939 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b9db5808-bf36-4d6e-9f66-5efd1e834ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:15.867430 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47956bb5-ab75-46cb-a750-1a42862232be admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:15.877217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:15.877873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:15.878155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:15.878770 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] PATH_INFO: `/v3/projects/00fd2b0dcc0e49d6bd1321cbcb832b9e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:15.882291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fd2b0dcc0e49d6bd1321cbcb832b9e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:15.888797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:15.992442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5808-bf36-4d6e-9f66-5efd1e834ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:15.994069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5808-bf36-4d6e-9f66-5efd1e834ad7 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:16.006302 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:16.036537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fd2b0dcc0e49d6bd1321cbcb832b9e', 'request_id': 'req-e8295656-00af-4e63-ae1f-6502be8244b1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:16.041415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1087/2203] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:16.050398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fd2b0dcc0e49d6bd1321cbcb832b9e', 'request_id': 'req-e8295656-00af-4e63-ae1f-6502be8244b1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:16.061901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fd2b0dcc0e49d6bd1321cbcb832b9e', 'request_id': 'req-e8295656-00af-4e63-ae1f-6502be8244b1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:16.082370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] The token cache is being invalidate because project 00fd2b0dcc0e49d6bd1321cbcb832b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:43:16.082764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:16.083607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:16.085687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1117/2204] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:43:15 2022] DELETE /identity/v3/projects/00fd2b0dcc0e49d6bd1321cbcb832b9e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:43:19.758993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4b220-8cdd-4fc2-85c8-3cc928cab6f3 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:19.759869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4b220-8cdd-4fc2-85c8-3cc928cab6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:19.759869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4b220-8cdd-4fc2-85c8-3cc928cab6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:19.800265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-fce4b220-8cdd-4fc2-85c8-3cc928cab6f3 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:19.802594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-fce4b220-8cdd-4fc2-85c8-3cc928cab6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:20.019681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1088/2205] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:43:20.051804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:20.054543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:20.230360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295656-00af-4e63-ae1f-6502be8244b1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:20.240080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389fcd-bdc8-4b3e-8b71-e49eb1066544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:20.241622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389fcd-bdc8-4b3e-8b71-e49eb1066544 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:20.241942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389fcd-bdc8-4b3e-8b71-e49eb1066544 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:20.243094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389fcd-bdc8-4b3e-8b71-e49eb1066544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:20.266118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1389fcd-bdc8-4b3e-8b71-e49eb1066544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:20.267791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1389fcd-bdc8-4b3e-8b71-e49eb1066544 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:20.280484 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1118/2206] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:26.252610 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7c23e-a42d-4618-b957-f4dd89539b6d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:26.254105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7c23e-a42d-4618-b957-f4dd89539b6d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:26.254851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7c23e-a42d-4618-b957-f4dd89539b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:26.300562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5dd7c23e-a42d-4618-b957-f4dd89539b6d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:26.303247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5dd7c23e-a42d-4618-b957-f4dd89539b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:26.316919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1089/2207] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:43:26.345963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389fcd-bdc8-4b3e-8b71-e49eb1066544 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:26.347676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b1389fcd-bdc8-4b3e-8b71-e49eb1066544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:26.398603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389fcd-bdc8-4b3e-8b71-e49eb1066544 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:26.417888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c391b5-1b9d-447d-93c0-bf6143e609f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:26.418532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c391b5-1b9d-447d-93c0-bf6143e609f0 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:26.418805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c391b5-1b9d-447d-93c0-bf6143e609f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:26.419115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c391b5-1b9d-447d-93c0-bf6143e609f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:26.448882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c391b5-1b9d-447d-93c0-bf6143e609f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:26.452243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c391b5-1b9d-447d-93c0-bf6143e609f0 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:26.486300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1119/2208] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:32.480649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50425-652c-487a-89db-51cd682eaa13 None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:32.481301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50425-652c-487a-89db-51cd682eaa13 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:32.482150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50425-652c-487a-89db-51cd682eaa13 None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:32.484780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1090/2209] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:43:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:43:32.494819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb200a04-8d82-4a12-a27d-8eb54cb580c7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:32.497215 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb200a04-8d82-4a12-a27d-8eb54cb580c7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:32.498162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb200a04-8d82-4a12-a27d-8eb54cb580c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:32.536005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-eb200a04-8d82-4a12-a27d-8eb54cb580c7 None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:32.538072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-eb200a04-8d82-4a12-a27d-8eb54cb580c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:32.555150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1120/2210] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:43:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:32.570361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50425-652c-487a-89db-51cd682eaa13 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:32.573527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-55f50425-652c-487a-89db-51cd682eaa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:32.663499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50425-652c-487a-89db-51cd682eaa13 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:32.672592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9a2f-3530-4331-a330-1d847441d418 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d055337c9a642bd9b8b5a60aacb11cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:32.673847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9a2f-3530-4331-a330-1d847441d418 service glance] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:32.674340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9a2f-3530-4331-a330-1d847441d418 service glance] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:32.675244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9a2f-3530-4331-a330-1d847441d418 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:32.693594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c9a2f-3530-4331-a330-1d847441d418 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:32.695944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c9a2f-3530-4331-a330-1d847441d418 service glance] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:32.712640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1091/2211] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:32.828881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b62e-c783-4b92-bbf0-fb0819951729 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:32.829193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b62e-c783-4b92-bbf0-fb0819951729 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:32.829475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b62e-c783-4b92-bbf0-fb0819951729 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:32.830906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1121/2212] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:43:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:43:32.838667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003f8e-4335-48da-a263-91592c32fecd None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:32.839093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003f8e-4335-48da-a263-91592c32fecd None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:32.839443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f003f8e-4335-48da-a263-91592c32fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:32.882560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7f003f8e-4335-48da-a263-91592c32fecd None None] MFA Rules not processed for user `a7a82c500de745c0b55df44b7f641706`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:32.884585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7f003f8e-4335-48da-a263-91592c32fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:32.989279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1092/2213] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:43:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:43:33.009086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b62e-c783-4b92-bbf0-fb0819951729 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:33.015323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d482b62e-c783-4b92-bbf0-fb0819951729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:33.039261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b62e-c783-4b92-bbf0-fb0819951729 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:33.044846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9b676-3e80-4a2f-ae72-fd739c07367f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:33.046179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b676-3e80-4a2f-ae72-fd739c07367f service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:33.046695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b676-3e80-4a2f-ae72-fd739c07367f service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:33.047074 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9b676-3e80-4a2f-ae72-fd739c07367f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:33.057035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9b676-3e80-4a2f-ae72-fd739c07367f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:33.060343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9b676-3e80-4a2f-ae72-fd739c07367f service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:33.065652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:33.071322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1122/2214] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:33.191977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9195b-39fe-4842-b27d-127f56878e9c None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:33.192275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9195b-39fe-4842-b27d-127f56878e9c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:33.192558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9195b-39fe-4842-b27d-127f56878e9c None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:33.194424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1093/2215] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 15:43:33.202813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423e4e1-d88a-4264-968f-6106fadd2d25 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:33.203078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423e4e1-d88a-4264-968f-6106fadd2d25 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:33.203260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423e4e1-d88a-4264-968f-6106fadd2d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:33.228119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d423e4e1-d88a-4264-968f-6106fadd2d25 None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:33.230995 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d423e4e1-d88a-4264-968f-6106fadd2d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:33.241474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1123/2216] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:33.257812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9195b-39fe-4842-b27d-127f56878e9c None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:33.262055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5cd9195b-39fe-4842-b27d-127f56878e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:33.285950 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9195b-39fe-4842-b27d-127f56878e9c None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:33.293076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917f000-3492-47e1-b14c-a30326b0ed4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:33.293715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917f000-3492-47e1-b14c-a30326b0ed4c service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:33.293984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917f000-3492-47e1-b14c-a30326b0ed4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:33.294248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917f000-3492-47e1-b14c-a30326b0ed4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:33.306655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917f000-3492-47e1-b14c-a30326b0ed4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:33.308833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917f000-3492-47e1-b14c-a30326b0ed4c service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:33.324568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1094/2217] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:40.484490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423e4e1-d88a-4264-968f-6106fadd2d25 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:40.485983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d423e4e1-d88a-4264-968f-6106fadd2d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:40.502350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423e4e1-d88a-4264-968f-6106fadd2d25 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:40.507723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:40.508412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:40.508713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:40.508944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] PATH_INFO: `/v3/users/7f907b01e7a944039259e2333a8578c6` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:40.510380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f907b01e7a944039259e2333a8578c6)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:40.512393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:40.596205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f907b01e7a944039259e2333a8578c6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:40.618794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f907b01e7a944039259e2333a8578c6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:40.619659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f907b01e7a944039259e2333a8578c6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:40.630785 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f907b01e7a944039259e2333a8578c6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:40.631800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f907b01e7a944039259e2333a8578c6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:40.657628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1124/2218] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:43:40 2022] DELETE /identity/v3/users/7f907b01e7a944039259e2333a8578c6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:40.663037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00842002-0305-4c81-bf32-d8413f8ebe1e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:40.663684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00842002-0305-4c81-bf32-d8413f8ebe1e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:40.663684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00842002-0305-4c81-bf32-d8413f8ebe1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:40.685331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-00842002-0305-4c81-bf32-d8413f8ebe1e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:40.686654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-00842002-0305-4c81-bf32-d8413f8ebe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:40.717565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:40.757729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1095/2219] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:40.771060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:40.772547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:40.841768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b8ac-37e0-4595-9687-a170e0501946 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:40.846090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c8bea-b208-4ee2-9663-e441bb72ddfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:40.846790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c8bea-b208-4ee2-9663-e441bb72ddfb service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:40.847093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c8bea-b208-4ee2-9663-e441bb72ddfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:40.847569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c8bea-b208-4ee2-9663-e441bb72ddfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:40.864610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c8bea-b208-4ee2-9663-e441bb72ddfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:40.866644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c8bea-b208-4ee2-9663-e441bb72ddfb service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:40.882213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1125/2220] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:41.578491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00842002-0305-4c81-bf32-d8413f8ebe1e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:41.584902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-00842002-0305-4c81-bf32-d8413f8ebe1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:41.612530 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00842002-0305-4c81-bf32-d8413f8ebe1e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:41.621797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:41.623839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:41.624153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:41.624439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] PATH_INFO: `/v3/projects/733377943b2e4b8289a49f9462c6bd50` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:41.626574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733377943b2e4b8289a49f9462c6bd50)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:41.629307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:41.709134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733377943b2e4b8289a49f9462c6bd50', 'request_id': 'req-294c42dd-a94a-4fda-8021-bc57ac6f8c35'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:41.724377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733377943b2e4b8289a49f9462c6bd50', 'request_id': 'req-294c42dd-a94a-4fda-8021-bc57ac6f8c35'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:41.734965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733377943b2e4b8289a49f9462c6bd50', 'request_id': 'req-294c42dd-a94a-4fda-8021-bc57ac6f8c35'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:41.751292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] The token cache is being invalidate because project 733377943b2e4b8289a49f9462c6bd50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:43:41.752105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:41.753338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-294c42dd-a94a-4fda-8021-bc57ac6f8c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:41.755896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1096/2221] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:43:41 2022] DELETE /identity/v3/projects/733377943b2e4b8289a49f9462c6bd50 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:41.762000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4416-199f-4d89-8fcb-600b228a4258 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:41.762792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4416-199f-4d89-8fcb-600b228a4258 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:41.763281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4416-199f-4d89-8fcb-600b228a4258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:41.802051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-342b4416-199f-4d89-8fcb-600b228a4258 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:41.804265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-342b4416-199f-4d89-8fcb-600b228a4258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:41.891086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1126/2222] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:41.965028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f810a86-8b8b-49c3-91fc-59aecfb60388 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:41.965525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f810a86-8b8b-49c3-91fc-59aecfb60388 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:41.965722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f810a86-8b8b-49c3-91fc-59aecfb60388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:41.989007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7f810a86-8b8b-49c3-91fc-59aecfb60388 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:41.990293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7f810a86-8b8b-49c3-91fc-59aecfb60388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:42.000042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1097/2223] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:43:42.004882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b4416-199f-4d89-8fcb-600b228a4258 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:42.017052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b4416-199f-4d89-8fcb-600b228a4258 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:42.022356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64a7e6-fd81-4745-b7fb-3f9991ea6a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:42.023058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64a7e6-fd81-4745-b7fb-3f9991ea6a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:42.023335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64a7e6-fd81-4745-b7fb-3f9991ea6a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:42.023668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64a7e6-fd81-4745-b7fb-3f9991ea6a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:42.024621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64a7e6-fd81-4745-b7fb-3f9991ea6a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:43:42.024997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64a7e6-fd81-4745-b7fb-3f9991ea6a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:42.027219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64a7e6-fd81-4745-b7fb-3f9991ea6a00 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:42.030216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:42.041271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1127/2224] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:43:42.047432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f810a86-8b8b-49c3-91fc-59aecfb60388 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:42.056812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f810a86-8b8b-49c3-91fc-59aecfb60388 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:42.061424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc302-9da4-4254-9657-fd833fb9ef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:42.062017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc302-9da4-4254-9657-fd833fb9ef35 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:42.062296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc302-9da4-4254-9657-fd833fb9ef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:42.062567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc302-9da4-4254-9657-fd833fb9ef35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:42.063233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc302-9da4-4254-9657-fd833fb9ef35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:42.065130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc302-9da4-4254-9657-fd833fb9ef35 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:42.094148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1098/2225] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:43:42 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:42.098438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64a7e6-fd81-4745-b7fb-3f9991ea6a00 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:42.109009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64a7e6-fd81-4745-b7fb-3f9991ea6a00 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:42.172265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d5298-13a4-47a9-8dac-6f9f8d3466a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:42.172876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d5298-13a4-47a9-8dac-6f9f8d3466a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:42.173149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d5298-13a4-47a9-8dac-6f9f8d3466a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:42.173425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d5298-13a4-47a9-8dac-6f9f8d3466a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:42.174068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d5298-13a4-47a9-8dac-6f9f8d3466a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:42.176104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d5298-13a4-47a9-8dac-6f9f8d3466a4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:42.197607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1128/2226] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:43:42 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:43:42.202365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc302-9da4-4254-9657-fd833fb9ef35 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:42.213163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc302-9da4-4254-9657-fd833fb9ef35 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:42.219503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f035f69-5560-48ad-904e-b2c8c9b6a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:42.220252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f035f69-5560-48ad-904e-b2c8c9b6a75c admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:42.220534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f035f69-5560-48ad-904e-b2c8c9b6a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:42.220810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f035f69-5560-48ad-904e-b2c8c9b6a75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:42.221540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f035f69-5560-48ad-904e-b2c8c9b6a75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:42.223602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f035f69-5560-48ad-904e-b2c8c9b6a75c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:42.234630 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1099/2227] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:42.240569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d5298-13a4-47a9-8dac-6f9f8d3466a4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:42.250900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d5298-13a4-47a9-8dac-6f9f8d3466a4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:42.255804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75067331-13f4-4371-a3be-0448f73176bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:42.256351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75067331-13f4-4371-a3be-0448f73176bd admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:42.256689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75067331-13f4-4371-a3be-0448f73176bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:42.256901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75067331-13f4-4371-a3be-0448f73176bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:42.257715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75067331-13f4-4371-a3be-0448f73176bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:42.259366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75067331-13f4-4371-a3be-0448f73176bd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:42.271873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1129/2228] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:43:42.277203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f035f69-5560-48ad-904e-b2c8c9b6a75c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:42.291704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f035f69-5560-48ad-904e-b2c8c9b6a75c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:42.296740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a3205-cbe6-4ffc-9c8c-927ad5fd7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:42.297539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a3205-cbe6-4ffc-9c8c-927ad5fd7fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:42.297977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a3205-cbe6-4ffc-9c8c-927ad5fd7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:42.298304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a3205-cbe6-4ffc-9c8c-927ad5fd7fbe admin admin] PATH_INFO: `/v3/projects/08616ee8612541e7b2fc2443b37b1d2a/users/c8fae29715cc4d43a5abd40c97f2ca76/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:42.317334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a3205-cbe6-4ffc-9c8c-927ad5fd7fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=08616ee8612541e7b2fc2443b37b1d2a, user_id=c8fae29715cc4d43a5abd40c97f2ca76, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:42.320197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a3205-cbe6-4ffc-9c8c-927ad5fd7fbe admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:42.334624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1100/2229] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:43:42 2022] PUT /identity/v3/projects/08616ee8612541e7b2fc2443b37b1d2a/users/c8fae29715cc4d43a5abd40c97f2ca76/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:43:42.345848 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa3737-4179-4d54-b1bc-cee7ec6a077c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:42.346142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa3737-4179-4d54-b1bc-cee7ec6a077c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:42.346428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa3737-4179-4d54-b1bc-cee7ec6a077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:42.378164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a4aa3737-4179-4d54-b1bc-cee7ec6a077c None None] MFA Rules not processed for user `c8fae29715cc4d43a5abd40c97f2ca76`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:42.379457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a4aa3737-4179-4d54-b1bc-cee7ec6a077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:42.469615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1130/2230] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:42.483006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a3205-cbe6-4ffc-9c8c-927ad5fd7fbe admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:42.483006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4e8a3205-cbe6-4ffc-9c8c-927ad5fd7fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:42.592984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a3205-cbe6-4ffc-9c8c-927ad5fd7fbe admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:42.597238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703cea-aaf7-47a4-92a1-a06804c7dd5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:42.597870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703cea-aaf7-47a4-92a1-a06804c7dd5b service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:42.598255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703cea-aaf7-47a4-92a1-a06804c7dd5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:42.598714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703cea-aaf7-47a4-92a1-a06804c7dd5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:42.605866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:42.610900 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703cea-aaf7-47a4-92a1-a06804c7dd5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:42.612785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703cea-aaf7-47a4-92a1-a06804c7dd5b service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:42.634710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1101/2231] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:43.687192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457ac2e-3749-41b9-becb-7a3247686fa8 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:43.687668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457ac2e-3749-41b9-becb-7a3247686fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:43.687895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457ac2e-3749-41b9-becb-7a3247686fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:43.707402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4457ac2e-3749-41b9-becb-7a3247686fa8 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:43.708682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4457ac2e-3749-41b9-becb-7a3247686fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:43.764889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1131/2232] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:43.776768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703cea-aaf7-47a4-92a1-a06804c7dd5b service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:43.778886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-39703cea-aaf7-47a4-92a1-a06804c7dd5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:43.862510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703cea-aaf7-47a4-92a1-a06804c7dd5b service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:43.867928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dad9b-7d10-40be-ba46-c5714e127ec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:43.868689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dad9b-7d10-40be-ba46-c5714e127ec9 service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:43.868981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dad9b-7d10-40be-ba46-c5714e127ec9 service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:43.869284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dad9b-7d10-40be-ba46-c5714e127ec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:43.878189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dad9b-7d10-40be-ba46-c5714e127ec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:43.879850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dad9b-7d10-40be-ba46-c5714e127ec9 service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:43.888349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1102/2233] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:43:48.023324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68424e-0633-4e2c-b0f3-53d10fd5fdb4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:48.023324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68424e-0633-4e2c-b0f3-53d10fd5fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:48.023324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68424e-0633-4e2c-b0f3-53d10fd5fdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:48.044665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bd68424e-0633-4e2c-b0f3-53d10fd5fdb4 None None] MFA Rules not processed for user `cfb9204220924a44a6bbda5e40b823d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:48.046244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bd68424e-0633-4e2c-b0f3-53d10fd5fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:48.051020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:48.118182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1132/2234] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:53.885211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=35 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:43:54.157487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dad9b-7d10-40be-ba46-c5714e127ec9 service swift] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:54.239987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dad9b-7d10-40be-ba46-c5714e127ec9 service swift] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:54.248752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:54.249771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:54.250082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:54.250363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] PATH_INFO: `/v3/users/c8fae29715cc4d43a5abd40c97f2ca76` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:54.251669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fae29715cc4d43a5abd40c97f2ca76)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:54.254590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:54.325359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fae29715cc4d43a5abd40c97f2ca76'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:54.326254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fae29715cc4d43a5abd40c97f2ca76'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:54.341971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fae29715cc4d43a5abd40c97f2ca76'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:54.360710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fae29715cc4d43a5abd40c97f2ca76'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:54.362114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fae29715cc4d43a5abd40c97f2ca76'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:54.382265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1103/2235] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:43:54 2022] DELETE /identity/v3/users/c8fae29715cc4d43a5abd40c97f2ca76 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:43:54.389850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e756d-3e8b-4a96-8374-8084c004399b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:54.390468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e756d-3e8b-4a96-8374-8084c004399b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:54.390831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e756d-3e8b-4a96-8374-8084c004399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:54.421275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2b6e756d-3e8b-4a96-8374-8084c004399b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:43:54.422424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2b6e756d-3e8b-4a96-8374-8084c004399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:54.499474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1133/2236] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:43:54.509389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:54.511440 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:54.574855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d633f5-bd28-4b9c-94b4-54f0df732abe admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:54.578474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051a7c3-7776-48e1-8236-61e05fe485e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:54.579114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051a7c3-7776-48e1-8236-61e05fe485e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:54.579395 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051a7c3-7776-48e1-8236-61e05fe485e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:54.579666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051a7c3-7776-48e1-8236-61e05fe485e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:54.588876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051a7c3-7776-48e1-8236-61e05fe485e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:54.590299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051a7c3-7776-48e1-8236-61e05fe485e6 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:54.600028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1104/2237] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:43:54.975784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e756d-3e8b-4a96-8374-8084c004399b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:43:54.978026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2b6e756d-3e8b-4a96-8374-8084c004399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:43:54.997580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e756d-3e8b-4a96-8374-8084c004399b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:43:55.003846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:43:55.004986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:43:55.005442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:43:55.005908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] PATH_INFO: `/v3/projects/08616ee8612541e7b2fc2443b37b1d2a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:43:55.007796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08616ee8612541e7b2fc2443b37b1d2a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:43:55.023936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:43:55.132148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08616ee8612541e7b2fc2443b37b1d2a', 'request_id': 'req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:55.152503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08616ee8612541e7b2fc2443b37b1d2a', 'request_id': 'req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:55.174720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08616ee8612541e7b2fc2443b37b1d2a', 'request_id': 'req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:55.210387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] The token cache is being invalidate because project 08616ee8612541e7b2fc2443b37b1d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:43:55.210387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:55.211752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:43:55.219064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1134/2238] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:43:54 2022] DELETE /identity/v3/projects/08616ee8612541e7b2fc2443b37b1d2a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:44:04.597348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:44:05.203131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:44:05.731129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5a044-38d8-40f7-b1e9-63503b352f97 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:05.731815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5a044-38d8-40f7-b1e9-63503b352f97 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:05.731815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5a044-38d8-40f7-b1e9-63503b352f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:05.755891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-30b5a044-38d8-40f7-b1e9-63503b352f97 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:05.757064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-30b5a044-38d8-40f7-b1e9-63503b352f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:05.859154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1105/2239] 10.222.0.89 () {58 vars in 967 bytes} [Fri Aug 26 15:44:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:44:05.872868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:44:05.874615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:05.985492 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff192c-9385-4d26-8c5a-55c8c7ef6fd5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:44:05.991884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09aa03-6d30-4568-a90f-f39acc41df68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:44:05.992760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09aa03-6d30-4568-a90f-f39acc41df68 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:05.993619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09aa03-6d30-4568-a90f-f39acc41df68 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:05.993619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09aa03-6d30-4568-a90f-f39acc41df68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:06.005254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09aa03-6d30-4568-a90f-f39acc41df68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:44:06.008328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09aa03-6d30-4568-a90f-f39acc41df68 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:44:06.021828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1135/2240] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:44:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:44:12.348466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231f228-4b1d-47fa-b1fb-ea0ac261ed8b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:12.349049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231f228-4b1d-47fa-b1fb-ea0ac261ed8b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:12.349049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231f228-4b1d-47fa-b1fb-ea0ac261ed8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:12.374919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-d231f228-4b1d-47fa-b1fb-ea0ac261ed8b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:12.376197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d231f228-4b1d-47fa-b1fb-ea0ac261ed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:12.449090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1106/2241] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:44:12.483136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09aa03-6d30-4568-a90f-f39acc41df68 service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:44:12.484823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3d09aa03-6d30-4568-a90f-f39acc41df68 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:12.573243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09aa03-6d30-4568-a90f-f39acc41df68 service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:44:12.580693 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91babd99-364f-4db8-890c-514c9bc623e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:44:12.582784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91babd99-364f-4db8-890c-514c9bc623e6 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:12.584113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91babd99-364f-4db8-890c-514c9bc623e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:12.584447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91babd99-364f-4db8-890c-514c9bc623e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:12.594367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91babd99-364f-4db8-890c-514c9bc623e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:44:12.596050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91babd99-364f-4db8-890c-514c9bc623e6 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:44:12.607283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1136/2242] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:44:16.673294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9070a-e148-4db0-ae46-4f6e1f294c5f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:16.673878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9070a-e148-4db0-ae46-4f6e1f294c5f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:16.673878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9070a-e148-4db0-ae46-4f6e1f294c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:16.695348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b1e9070a-e148-4db0-ae46-4f6e1f294c5f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:16.696600 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b1e9070a-e148-4db0-ae46-4f6e1f294c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:16.705409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1107/2243] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:44:16.729113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91babd99-364f-4db8-890c-514c9bc623e6 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:44:16.741373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91babd99-364f-4db8-890c-514c9bc623e6 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:44:16.748052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c057a0-979d-4524-8dbc-ea84d008c5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:44:16.748729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c057a0-979d-4524-8dbc-ea84d008c5cb service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:16.749012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c057a0-979d-4524-8dbc-ea84d008c5cb service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:16.749285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c057a0-979d-4524-8dbc-ea84d008c5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:16.758543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c057a0-979d-4524-8dbc-ea84d008c5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:44:16.760201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c057a0-979d-4524-8dbc-ea84d008c5cb service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:44:16.770748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1137/2244] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:44:20.768733 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa4eda-d90a-467a-869d-7ba6793f5cc0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:20.769557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa4eda-d90a-467a-869d-7ba6793f5cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:20.769557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa4eda-d90a-467a-869d-7ba6793f5cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:20.793117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-a1aa4eda-d90a-467a-869d-7ba6793f5cc0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:20.793973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a1aa4eda-d90a-467a-869d-7ba6793f5cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:20.809570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1108/2245] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:44:20.875227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c057a0-979d-4524-8dbc-ea84d008c5cb service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:44:20.888423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c057a0-979d-4524-8dbc-ea84d008c5cb service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:44:20.895074 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b8040-272c-48a7-9875-bd4358ce2b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:44:20.895814 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b8040-272c-48a7-9875-bd4358ce2b0a service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:20.896154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b8040-272c-48a7-9875-bd4358ce2b0a service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:20.896506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b8040-272c-48a7-9875-bd4358ce2b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:20.907218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b8040-272c-48a7-9875-bd4358ce2b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:44:20.908829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b8040-272c-48a7-9875-bd4358ce2b0a service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:44:20.924955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1138/2246] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:44:24.997331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63324c9e-0390-45d9-b424-3e4daf549cc1 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:24.998307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63324c9e-0390-45d9-b424-3e4daf549cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:24.998307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63324c9e-0390-45d9-b424-3e4daf549cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:25.019803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-63324c9e-0390-45d9-b424-3e4daf549cc1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:25.021044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-63324c9e-0390-45d9-b424-3e4daf549cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:25.030288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1109/2247] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:44:25.053716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b8040-272c-48a7-9875-bd4358ce2b0a service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:44:25.056673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-278b8040-272c-48a7-9875-bd4358ce2b0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:25.084513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b8040-272c-48a7-9875-bd4358ce2b0a service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:44:25.095528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d8e84-e026-4e29-9ce5-08041aa15b11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:44:25.096944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d8e84-e026-4e29-9ce5-08041aa15b11 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:25.097649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d8e84-e026-4e29-9ce5-08041aa15b11 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:25.098018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d8e84-e026-4e29-9ce5-08041aa15b11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:25.115190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d8e84-e026-4e29-9ce5-08041aa15b11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:44:25.118522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d8e84-e026-4e29-9ce5-08041aa15b11 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:44:25.138391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1139/2248] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:44:28.228719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651a337-a795-4e24-8400-e8f069a5090f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:28.229366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651a337-a795-4e24-8400-e8f069a5090f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:28.229366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651a337-a795-4e24-8400-e8f069a5090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:28.258529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-d651a337-a795-4e24-8400-e8f069a5090f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:28.259743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d651a337-a795-4e24-8400-e8f069a5090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:28.268706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1110/2249] 10.222.0.93 () {58 vars in 1016 bytes} [Fri Aug 26 15:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:44:28.308734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d8e84-e026-4e29-9ce5-08041aa15b11 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:44:28.320903 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d8e84-e026-4e29-9ce5-08041aa15b11 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:44:28.328215 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4146b3-f160-4c09-883d-8b123dea6e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:44:28.329129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4146b3-f160-4c09-883d-8b123dea6e31 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:28.329518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4146b3-f160-4c09-883d-8b123dea6e31 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:28.329889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4146b3-f160-4c09-883d-8b123dea6e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:28.341657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4146b3-f160-4c09-883d-8b123dea6e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:44:28.343523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4146b3-f160-4c09-883d-8b123dea6e31 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:44:28.355113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1140/2250] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:44:38.253641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=64 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:44:38.349860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:44:40.137866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093622f-cba6-4d50-baa9-21665beedf53 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:40.138538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093622f-cba6-4d50-baa9-21665beedf53 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:40.138848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093622f-cba6-4d50-baa9-21665beedf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:40.170109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-3093622f-cba6-4d50-baa9-21665beedf53 None None] MFA Rules not processed for user `e56d4b78d51b4a81842f5724aaff7f85`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:40.171743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3093622f-cba6-4d50-baa9-21665beedf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:40.259674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1111/2251] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:44:46.552539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcbaa6-c307-4643-9a02-9aabb7aec577 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:44:46.553093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcbaa6-c307-4643-9a02-9aabb7aec577 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:44:46.553093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcbaa6-c307-4643-9a02-9aabb7aec577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:44:46.578862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-71bcbaa6-c307-4643-9a02-9aabb7aec577 None None] MFA Rules not processed for user `66a5f1265c2f44fbb9a58d8d163b8460`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:44:46.580943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-71bcbaa6-c307-4643-9a02-9aabb7aec577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:44:46.654893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1141/2252] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:44:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:44:50.249996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=25 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:44:56.643932 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=25 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:05.625043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31167be8-6609-4e0f-a217-a9c5a1046b05 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:05.625841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31167be8-6609-4e0f-a217-a9c5a1046b05 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:05.626002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31167be8-6609-4e0f-a217-a9c5a1046b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:05.653411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-31167be8-6609-4e0f-a217-a9c5a1046b05 None None] MFA Rules not processed for user `f865fb654778404a846ec2465eeef8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:05.654658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-31167be8-6609-4e0f-a217-a9c5a1046b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:05.748922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1112/2253] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:45:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:45:06.266747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcbaa6-c307-4643-9a02-9aabb7aec577 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:06.268462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-71bcbaa6-c307-4643-9a02-9aabb7aec577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:06.289262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcbaa6-c307-4643-9a02-9aabb7aec577 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:06.296873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:06.297951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:06.298431 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:06.298872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] PATH_INFO: `/v3/users/cfb9204220924a44a6bbda5e40b823d7` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:06.300650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb9204220924a44a6bbda5e40b823d7)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:06.304262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:06.384058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb9204220924a44a6bbda5e40b823d7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.400613 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb9204220924a44a6bbda5e40b823d7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.402196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb9204220924a44a6bbda5e40b823d7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.413486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb9204220924a44a6bbda5e40b823d7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.414136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-a0a83abf-24b6-492d-98a8-1da0edfd1d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb9204220924a44a6bbda5e40b823d7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.429382 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1142/2254] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:45:06 2022] DELETE /identity/v3/users/cfb9204220924a44a6bbda5e40b823d7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:45:06.674582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31167be8-6609-4e0f-a217-a9c5a1046b05 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:06.696915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31167be8-6609-4e0f-a217-a9c5a1046b05 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:06.828840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:06.829956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:06.830243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:06.830508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] PATH_INFO: `/v3/projects/737e08f79dcf406e8d4ddde26e11cfa2` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:06.831759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737e08f79dcf406e8d4ddde26e11cfa2)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:06.833758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:06.909407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737e08f79dcf406e8d4ddde26e11cfa2', 'request_id': 'req-53287667-46cc-4851-b62c-7b0ee5dc8160'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.920405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737e08f79dcf406e8d4ddde26e11cfa2', 'request_id': 'req-53287667-46cc-4851-b62c-7b0ee5dc8160'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.927718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737e08f79dcf406e8d4ddde26e11cfa2', 'request_id': 'req-53287667-46cc-4851-b62c-7b0ee5dc8160'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.941827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] The token cache is being invalidate because project 737e08f79dcf406e8d4ddde26e11cfa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:45:06.942181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.942829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:45:06.944859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1113/2255] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:45:06 2022] DELETE /identity/v3/projects/737e08f79dcf406e8d4ddde26e11cfa2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:45:16.432459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:16.937562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:21.017312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf18b2e-dc92-4ca5-841c-9a3b570cdb80 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:21.018466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf18b2e-dc92-4ca5-841c-9a3b570cdb80 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:21.018466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf18b2e-dc92-4ca5-841c-9a3b570cdb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:21.039943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1cf18b2e-dc92-4ca5-841c-9a3b570cdb80 None None] MFA Rules not processed for user `91137d4fc46f401aa969752a5adf176f`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:21.041183 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1cf18b2e-dc92-4ca5-841c-9a3b570cdb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:21.107698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1143/2256] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:21.148430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:21.149427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:21.218029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53287667-46cc-4851-b62c-7b0ee5dc8160 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:21.221985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d055337c9a642bd9b8b5a60aacb11cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:21.222609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:21.222888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:21.223190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:21.225417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:21.308439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:21.309896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:21.322622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1114/2257] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:22.280496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf18b2e-dc92-4ca5-841c-9a3b570cdb80 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:22.282141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1cf18b2e-dc92-4ca5-841c-9a3b570cdb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:22.360854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf18b2e-dc92-4ca5-841c-9a3b570cdb80 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:22.365430 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4afb4-25cc-42ee-b64c-6f2037f05e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:22.366133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4afb4-25cc-42ee-b64c-6f2037f05e9f service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:22.366567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4afb4-25cc-42ee-b64c-6f2037f05e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:22.367070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4afb4-25cc-42ee-b64c-6f2037f05e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:22.372449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5ab4afb4-25cc-42ee-b64c-6f2037f05e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:22.391392 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4afb4-25cc-42ee-b64c-6f2037f05e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:22.393004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4afb4-25cc-42ee-b64c-6f2037f05e9f service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:22.407034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1144/2258] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:31.316549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=54 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:32.401796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=51 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:33.446704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:33.449051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:33.553243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320464a5-6be5-4af9-b366-8078b896e444 service glance] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:33.559663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf149ec-178b-4aeb-9173-f1bde616faa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:33.560632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf149ec-178b-4aeb-9173-f1bde616faa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:33.561097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf149ec-178b-4aeb-9173-f1bde616faa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:33.561572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf149ec-178b-4aeb-9173-f1bde616faa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:33.565512 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bbf149ec-178b-4aeb-9173-f1bde616faa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:33.661510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf149ec-178b-4aeb-9173-f1bde616faa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:33.663287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf149ec-178b-4aeb-9173-f1bde616faa1 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:33.681858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1115/2259] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:43.673405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=48 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:45:49.745035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4afb4-25cc-42ee-b64c-6f2037f05e9f service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:49.768891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4afb4-25cc-42ee-b64c-6f2037f05e9f service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:49.775630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ac10-68e0-4c59-be49-84e560e336a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:49.777462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ac10-68e0-4c59-be49-84e560e336a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:49.781801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ac10-68e0-4c59-be49-84e560e336a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:49.781801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ac10-68e0-4c59-be49-84e560e336a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:49.789543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-71e3ac10-68e0-4c59-be49-84e560e336a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:49.806716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3ac10-68e0-4c59-be49-84e560e336a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:49.809579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3ac10-68e0-4c59-be49-84e560e336a1 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:49.826292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1145/2260] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:54.654730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf149ec-178b-4aeb-9173-f1bde616faa1 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:54.665394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf149ec-178b-4aeb-9173-f1bde616faa1 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:54.670275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673fbdd-e09d-4e99-89d4-fd35923ef156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:54.671412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673fbdd-e09d-4e99-89d4-fd35923ef156 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:54.671723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673fbdd-e09d-4e99-89d4-fd35923ef156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:54.672205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673fbdd-e09d-4e99-89d4-fd35923ef156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:54.675060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8673fbdd-e09d-4e99-89d4-fd35923ef156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:54.757845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673fbdd-e09d-4e99-89d4-fd35923ef156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:54.759529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673fbdd-e09d-4e99-89d4-fd35923ef156 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:54.774806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1116/2261] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:54.999529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a29c6-5d12-467e-bdaf-a2b5b998715f None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:55.000898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a29c6-5d12-467e-bdaf-a2b5b998715f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:55.001533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a29c6-5d12-467e-bdaf-a2b5b998715f None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:55.004249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1146/2262] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:45:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:45:55.015466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa84fc-ece7-42f3-bffe-9d3184c0d501 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:55.015945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa84fc-ece7-42f3-bffe-9d3184c0d501 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:55.016382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa84fc-ece7-42f3-bffe-9d3184c0d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:55.072591 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-16aa84fc-ece7-42f3-bffe-9d3184c0d501 None None] MFA Rules not processed for user `a7a82c500de745c0b55df44b7f641706`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:55.080576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-16aa84fc-ece7-42f3-bffe-9d3184c0d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:55.100091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1117/2263] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:45:55.127008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a29c6-5d12-467e-bdaf-a2b5b998715f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:55.146728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a29c6-5d12-467e-bdaf-a2b5b998715f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:55.154736 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac71fd1-46b6-4c0e-8463-fb0fc2ca214c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:55.155854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac71fd1-46b6-4c0e-8463-fb0fc2ca214c service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:55.156277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac71fd1-46b6-4c0e-8463-fb0fc2ca214c service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:55.156694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac71fd1-46b6-4c0e-8463-fb0fc2ca214c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:55.171110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac71fd1-46b6-4c0e-8463-fb0fc2ca214c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:55.174303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac71fd1-46b6-4c0e-8463-fb0fc2ca214c service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:55.191195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1147/2264] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:45:55.319993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef53c57-212e-4995-ace5-73ada092504c None None] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:55.320287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef53c57-212e-4995-ace5-73ada092504c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:55.320571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef53c57-212e-4995-ace5-73ada092504c None None] PATH_INFO: `/` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:55.321942 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1118/2265] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:45:55.328812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d827e-d388-443c-a8ac-564fae94dcb5 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:55.329222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d827e-d388-443c-a8ac-564fae94dcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:55.329624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d827e-d388-443c-a8ac-564fae94dcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:55.357646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c16d827e-d388-443c-a8ac-564fae94dcb5 None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:45:55.358890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c16d827e-d388-443c-a8ac-564fae94dcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:55.372441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1148/2266] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:45:55.391346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef53c57-212e-4995-ace5-73ada092504c None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:55.405787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef53c57-212e-4995-ace5-73ada092504c None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:55.409601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca2b07-cb62-4984-91bc-8385ca290af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:55.410214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca2b07-cb62-4984-91bc-8385ca290af7 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:55.410500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca2b07-cb62-4984-91bc-8385ca290af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:55.410785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca2b07-cb62-4984-91bc-8385ca290af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:55.423927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca2b07-cb62-4984-91bc-8385ca290af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:55.426497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca2b07-cb62-4984-91bc-8385ca290af7 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:55.445385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1119/2267] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:45:55.524993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d827e-d388-443c-a8ac-564fae94dcb5 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:45:55.526437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c16d827e-d388-443c-a8ac-564fae94dcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:55.607698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d827e-d388-443c-a8ac-564fae94dcb5 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:45:55.615347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:45:55.615985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:45:55.616270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:45:55.616551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:45:55.618390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:45:55.633026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:45:55.634660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:45:55.649121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1149/2268] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:45:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:01.736384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca2b07-cb62-4984-91bc-8385ca290af7 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:01.739065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a1ca2b07-cb62-4984-91bc-8385ca290af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:01.766601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca2b07-cb62-4984-91bc-8385ca290af7 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:01.784592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:01.785509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:01.786152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:01.786606 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:01.789757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:01.810174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:01.832960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:01.899418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1120/2269] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:03.083244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:03.085605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:03.101539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d28ff-6ae5-4f6d-9667-b01dfd5bfe8f service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:03.108049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1019a-4853-4b39-86f6-548706ac7965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:03.108684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1019a-4853-4b39-86f6-548706ac7965 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:03.108958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1019a-4853-4b39-86f6-548706ac7965 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:03.109232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1019a-4853-4b39-86f6-548706ac7965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:03.112998 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-26d1019a-4853-4b39-86f6-548706ac7965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:03.232455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1019a-4853-4b39-86f6-548706ac7965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:03.234787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1019a-4853-4b39-86f6-548706ac7965 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:03.254606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1150/2270] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:04.769082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:04.773494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:04.792855 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340cce-5825-41f7-9353-b46055dfc7e7 service nova] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:04.799263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41daec-fe16-4d45-8ea1-8c1668d180d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:04.800300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41daec-fe16-4d45-8ea1-8c1668d180d0 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:04.800744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41daec-fe16-4d45-8ea1-8c1668d180d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:04.801216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41daec-fe16-4d45-8ea1-8c1668d180d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:04.803913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-cd41daec-fe16-4d45-8ea1-8c1668d180d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:04.899865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41daec-fe16-4d45-8ea1-8c1668d180d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:04.901316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41daec-fe16-4d45-8ea1-8c1668d180d0 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:04.913503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1121/2271] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:07.254568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e5fd-4430-4049-83bb-d27a9e4c5ed6 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:07.255319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e5fd-4430-4049-83bb-d27a9e4c5ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:07.255930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e5fd-4430-4049-83bb-d27a9e4c5ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:07.299779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9486e5fd-4430-4049-83bb-d27a9e4c5ed6 None None] MFA Rules not processed for user `e56d4b78d51b4a81842f5724aaff7f85`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:07.302730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9486e5fd-4430-4049-83bb-d27a9e4c5ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:07.319100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1151/2272] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:07.871889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41daec-fe16-4d45-8ea1-8c1668d180d0 service nova] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:07.885075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41daec-fe16-4d45-8ea1-8c1668d180d0 service nova] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:07.889263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:07.889903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:07.890184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:07.890455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:07.892471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:07.906224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:07.908078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:07.919970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1122/2273] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:08.393176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486e5fd-4430-4049-83bb-d27a9e4c5ed6 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:08.425671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486e5fd-4430-4049-83bb-d27a9e4c5ed6 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:08.438776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d4089-cc6a-45fd-92ce-8bc920d2fff9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:08.441500 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d4089-cc6a-45fd-92ce-8bc920d2fff9 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:08.442480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d4089-cc6a-45fd-92ce-8bc920d2fff9 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:08.443328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d4089-cc6a-45fd-92ce-8bc920d2fff9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:08.449487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6c0d4089-cc6a-45fd-92ce-8bc920d2fff9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:08.485607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d4089-cc6a-45fd-92ce-8bc920d2fff9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:08.487744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d4089-cc6a-45fd-92ce-8bc920d2fff9 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:08.532573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1152/2274] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:08.538323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:08.541790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:08.595754 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc0904-e48d-4155-b66a-5712f3417874 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:08.601239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:08.602126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:08.602409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:08.602913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] PATH_INFO: `/v3/users/66a5f1265c2f44fbb9a58d8d163b8460` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:08.605862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a5f1265c2f44fbb9a58d8d163b8460)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:08.608116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:08.695785 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:08.699583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a5f1265c2f44fbb9a58d8d163b8460'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:08.701636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a5f1265c2f44fbb9a58d8d163b8460'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:08.751820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a5f1265c2f44fbb9a58d8d163b8460'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:08.783910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a5f1265c2f44fbb9a58d8d163b8460'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:08.785099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-529861bf-92e4-49e0-b450-445d9d80a2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a5f1265c2f44fbb9a58d8d163b8460'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:08.810218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1123/2275] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:08 2022] DELETE /identity/v3/users/66a5f1265c2f44fbb9a58d8d163b8460 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:09.159237 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d4089-cc6a-45fd-92ce-8bc920d2fff9 service placement] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:09.176716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d4089-cc6a-45fd-92ce-8bc920d2fff9 service placement] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:09.215553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:09.251839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:09.252520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:09.252807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:09.253084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] PATH_INFO: `/v3/projects/293d131d2aff448eb7d28660c2884bcc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:09.254348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293d131d2aff448eb7d28660c2884bcc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:09.256474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:09.342789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293d131d2aff448eb7d28660c2884bcc', 'request_id': 'req-7870922a-1326-4a49-b3d1-cfeaa2363cc7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:09.351431 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293d131d2aff448eb7d28660c2884bcc', 'request_id': 'req-7870922a-1326-4a49-b3d1-cfeaa2363cc7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:09.364332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293d131d2aff448eb7d28660c2884bcc', 'request_id': 'req-7870922a-1326-4a49-b3d1-cfeaa2363cc7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:09.380742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] The token cache is being invalidate because project 293d131d2aff448eb7d28660c2884bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:09.381540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:09.381945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-7870922a-1326-4a49-b3d1-cfeaa2363cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:09.383876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1153/2276] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:09 2022] DELETE /identity/v3/projects/293d131d2aff448eb7d28660c2884bcc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:09.404254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da9551-cebc-4815-827a-3c12d6e4b892 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:09.405926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da9551-cebc-4815-827a-3c12d6e4b892 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:09.406446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da9551-cebc-4815-827a-3c12d6e4b892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:09.455552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-48da9551-cebc-4815-827a-3c12d6e4b892 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:09.457177 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-48da9551-cebc-4815-827a-3c12d6e4b892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:09.550323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1124/2277] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:09.552375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3a598-f432-4ec7-ac9b-998a5b7888be None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:09.552952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3a598-f432-4ec7-ac9b-998a5b7888be None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:09.553137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3a598-f432-4ec7-ac9b-998a5b7888be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:09.579238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-75f3a598-f432-4ec7-ac9b-998a5b7888be None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:09.580959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-75f3a598-f432-4ec7-ac9b-998a5b7888be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:09.591874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1154/2278] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:09.596564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da9551-cebc-4815-827a-3c12d6e4b892 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:09.618360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da9551-cebc-4815-827a-3c12d6e4b892 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:09.628234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bbe44-dde4-4971-87bc-068294ab4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:09.629800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bbe44-dde4-4971-87bc-068294ab4263 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:09.631444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bbe44-dde4-4971-87bc-068294ab4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:09.632252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bbe44-dde4-4971-87bc-068294ab4263 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:09.634364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bbe44-dde4-4971-87bc-068294ab4263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:09.635267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bbe44-dde4-4971-87bc-068294ab4263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:09.639839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bbe44-dde4-4971-87bc-068294ab4263 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:09.660887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1125/2279] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:09.667021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3a598-f432-4ec7-ac9b-998a5b7888be None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:09.678260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3a598-f432-4ec7-ac9b-998a5b7888be None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:09.683773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c089-80b0-4ac2-ad03-8848d33796a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:09.684762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c089-80b0-4ac2-ad03-8848d33796a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:09.685042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c089-80b0-4ac2-ad03-8848d33796a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:09.685322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c089-80b0-4ac2-ad03-8848d33796a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:09.685992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c089-80b0-4ac2-ad03-8848d33796a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:09.688167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c089-80b0-4ac2-ad03-8848d33796a6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:09.750496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1155/2280] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:09 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:09.756253 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bbe44-dde4-4971-87bc-068294ab4263 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:09.767523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bbe44-dde4-4971-87bc-068294ab4263 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:09.841201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ab919-228e-4893-8a9b-0229c64d833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:09.841902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ab919-228e-4893-8a9b-0229c64d833c admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:09.842313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ab919-228e-4893-8a9b-0229c64d833c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:09.842728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ab919-228e-4893-8a9b-0229c64d833c admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:09.843695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ab919-228e-4893-8a9b-0229c64d833c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:09.846242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ab919-228e-4893-8a9b-0229c64d833c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:09.880366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1126/2281] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:09 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:09.885223 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c089-80b0-4ac2-ad03-8848d33796a6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:09.898557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c089-80b0-4ac2-ad03-8848d33796a6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:09.906471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953ab3a-8645-4a89-a5bd-3af6f73ae79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:09.907203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953ab3a-8645-4a89-a5bd-3af6f73ae79d admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:09.907672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953ab3a-8645-4a89-a5bd-3af6f73ae79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:09.907936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953ab3a-8645-4a89-a5bd-3af6f73ae79d admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:09.908781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953ab3a-8645-4a89-a5bd-3af6f73ae79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:09.910833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953ab3a-8645-4a89-a5bd-3af6f73ae79d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:09.927860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1156/2282] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:09.932309 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ab919-228e-4893-8a9b-0229c64d833c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:09.943557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ab919-228e-4893-8a9b-0229c64d833c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:09.948121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47f963-14bf-4053-a105-950e60a9f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:09.949325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f963-14bf-4053-a105-950e60a9f73a admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:09.949607 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f963-14bf-4053-a105-950e60a9f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:09.949881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f963-14bf-4053-a105-950e60a9f73a admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:09.950537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47f963-14bf-4053-a105-950e60a9f73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:09.952233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47f963-14bf-4053-a105-950e60a9f73a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:09.964494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1127/2283] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:09.968925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953ab3a-8645-4a89-a5bd-3af6f73ae79d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:09.982192 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953ab3a-8645-4a89-a5bd-3af6f73ae79d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:09.987982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ac881-864b-44e0-8dde-32a191df99ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:09.988663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ac881-864b-44e0-8dde-32a191df99ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:09.988942 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ac881-864b-44e0-8dde-32a191df99ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:09.989217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ac881-864b-44e0-8dde-32a191df99ed admin admin] PATH_INFO: `/v3/projects/4ad612f09abc4ddca346f8ce30276dfe/users/a69b1281d3134ac8b01b657c90ad0d13/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:10.010492 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ac881-864b-44e0-8dde-32a191df99ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad612f09abc4ddca346f8ce30276dfe, user_id=a69b1281d3134ac8b01b657c90ad0d13, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:10.015602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ac881-864b-44e0-8dde-32a191df99ed admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:10.034569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1157/2284] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:09 2022] PUT /identity/v3/projects/4ad612f09abc4ddca346f8ce30276dfe/users/a69b1281d3134ac8b01b657c90ad0d13/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:10.045771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982754c-5ad3-4f68-8298-c392b67c6223 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:10.046213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982754c-5ad3-4f68-8298-c392b67c6223 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:10.046555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982754c-5ad3-4f68-8298-c392b67c6223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:10.086122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-2982754c-5ad3-4f68-8298-c392b67c6223 None None] MFA Rules not processed for user `a69b1281d3134ac8b01b657c90ad0d13`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:10.087396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2982754c-5ad3-4f68-8298-c392b67c6223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:10.107434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:10.182257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1128/2285] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:10.187592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ac881-864b-44e0-8dde-32a191df99ed admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:10.272490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:10.280290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ac881-864b-44e0-8dde-32a191df99ed admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:10.290702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e9b3-285a-48c5-861e-be250ba33afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:10.291677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e9b3-285a-48c5-861e-be250ba33afe admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:10.292025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e9b3-285a-48c5-861e-be250ba33afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:10.292918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e9b3-285a-48c5-861e-be250ba33afe admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:10.293758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6e9b3-285a-48c5-861e-be250ba33afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:10.297128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6e9b3-285a-48c5-861e-be250ba33afe admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:10.360086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1158/2286] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:10 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:10.362449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982754c-5ad3-4f68-8298-c392b67c6223 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:10.382142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982754c-5ad3-4f68-8298-c392b67c6223 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:10.509521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf5535-a7f2-478d-aa7c-c0af70213766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:10.510243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf5535-a7f2-478d-aa7c-c0af70213766 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:10.510629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf5535-a7f2-478d-aa7c-c0af70213766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:10.511545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf5535-a7f2-478d-aa7c-c0af70213766 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:10.512196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf5535-a7f2-478d-aa7c-c0af70213766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:10.514658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf5535-a7f2-478d-aa7c-c0af70213766 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:10.541640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1129/2287] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:10 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:10.543142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e9b3-285a-48c5-861e-be250ba33afe admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:10.554622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e9b3-285a-48c5-861e-be250ba33afe admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:10.561426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cbb52-2662-48e1-9000-8a785674a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:10.562456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cbb52-2662-48e1-9000-8a785674a6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:10.562972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cbb52-2662-48e1-9000-8a785674a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:10.563445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cbb52-2662-48e1-9000-8a785674a6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:10.564340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cbb52-2662-48e1-9000-8a785674a6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:10.566368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cbb52-2662-48e1-9000-8a785674a6d3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:10.582479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1159/2288] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:10.589016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf5535-a7f2-478d-aa7c-c0af70213766 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:10.621461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf5535-a7f2-478d-aa7c-c0af70213766 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:10.643976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae244b-0917-463f-9787-f5cc321d59dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:10.643976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae244b-0917-463f-9787-f5cc321d59dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:10.644869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae244b-0917-463f-9787-f5cc321d59dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:10.644869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae244b-0917-463f-9787-f5cc321d59dd admin admin] PATH_INFO: `/v3/projects/7d96f2caff134d5daf7c37ec8a0e996f/users/c7ec8e4c39304eaa8ace5adc7549b317/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:10.670775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae244b-0917-463f-9787-f5cc321d59dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d96f2caff134d5daf7c37ec8a0e996f, user_id=c7ec8e4c39304eaa8ace5adc7549b317, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:10.675289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae244b-0917-463f-9787-f5cc321d59dd admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:10.695424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1130/2289] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:10 2022] PUT /identity/v3/projects/7d96f2caff134d5daf7c37ec8a0e996f/users/c7ec8e4c39304eaa8ace5adc7549b317/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:10.699967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cbb52-2662-48e1-9000-8a785674a6d3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:10.712880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cbb52-2662-48e1-9000-8a785674a6d3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:10.866742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea4cb3-3ca1-43f4-86d8-cf8a569a44f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:10.868210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4cb3-3ca1-43f4-86d8-cf8a569a44f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:10.868963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4cb3-3ca1-43f4-86d8-cf8a569a44f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:10.869642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4cb3-3ca1-43f4-86d8-cf8a569a44f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:10.872927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4cb3-3ca1-43f4-86d8-cf8a569a44f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:10.877612 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4cb3-3ca1-43f4-86d8-cf8a569a44f5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:10.916916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1160/2290] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:10.919019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae244b-0917-463f-9787-f5cc321d59dd admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:10.951563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae244b-0917-463f-9787-f5cc321d59dd admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:10.971808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2729b8a-8c00-4339-9d2a-b7c006b4dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:10.972689 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2729b8a-8c00-4339-9d2a-b7c006b4dee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:10.973044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2729b8a-8c00-4339-9d2a-b7c006b4dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:10.973641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2729b8a-8c00-4339-9d2a-b7c006b4dee0 admin admin] PATH_INFO: `/v3/projects/7d96f2caff134d5daf7c37ec8a0e996f/users/c7ec8e4c39304eaa8ace5adc7549b317/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:10.976841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2729b8a-8c00-4339-9d2a-b7c006b4dee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d96f2caff134d5daf7c37ec8a0e996f, user_id=c7ec8e4c39304eaa8ace5adc7549b317, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:10.981297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2729b8a-8c00-4339-9d2a-b7c006b4dee0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:11.011055 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1131/2291] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:10 2022] PUT /identity/v3/projects/7d96f2caff134d5daf7c37ec8a0e996f/users/c7ec8e4c39304eaa8ace5adc7549b317/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:11.023393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236069-1709-4deb-954f-dd758b4c0f0b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:11.024009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236069-1709-4deb-954f-dd758b4c0f0b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:11.024396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80236069-1709-4deb-954f-dd758b4c0f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:11.068592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-80236069-1709-4deb-954f-dd758b4c0f0b None None] MFA Rules not processed for user `c7ec8e4c39304eaa8ace5adc7549b317`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:11.069748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-80236069-1709-4deb-954f-dd758b4c0f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:11.163748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1161/2292] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:11.175795 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2729b8a-8c00-4339-9d2a-b7c006b4dee0 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:11.177680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c2729b8a-8c00-4339-9d2a-b7c006b4dee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:11.262281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2729b8a-8c00-4339-9d2a-b7c006b4dee0 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:11.266702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a11ed-6d74-4795-8f5d-f3866353db12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:11.267660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a11ed-6d74-4795-8f5d-f3866353db12 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:11.267945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a11ed-6d74-4795-8f5d-f3866353db12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:11.268327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a11ed-6d74-4795-8f5d-f3866353db12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:11.308325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:11.376128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a11ed-6d74-4795-8f5d-f3866353db12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:11.377383 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a11ed-6d74-4795-8f5d-f3866353db12 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:11.393398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1132/2293] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:12.962272 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236069-1709-4deb-954f-dd758b4c0f0b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:12.965055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-80236069-1709-4deb-954f-dd758b4c0f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:12.982144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80236069-1709-4deb-954f-dd758b4c0f0b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:12.986152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ecda-f20f-42a2-bc78-e14f9092ab4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:12.986778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ecda-f20f-42a2-bc78-e14f9092ab4c service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:12.987096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ecda-f20f-42a2-bc78-e14f9092ab4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:12.987372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ecda-f20f-42a2-bc78-e14f9092ab4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:13.000308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2ecda-f20f-42a2-bc78-e14f9092ab4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:13.002854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2ecda-f20f-42a2-bc78-e14f9092ab4c service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:13.018502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1162/2294] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:16.985595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a11ed-6d74-4795-8f5d-f3866353db12 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:17.066011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a11ed-6d74-4795-8f5d-f3866353db12 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:17.071435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:17.072249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:17.072597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:17.072926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] PATH_INFO: `/v3/users/a69b1281d3134ac8b01b657c90ad0d13` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:17.076884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69b1281d3134ac8b01b657c90ad0d13)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:17.078590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:17.157278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69b1281d3134ac8b01b657c90ad0d13'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:17.158546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69b1281d3134ac8b01b657c90ad0d13'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:17.183649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69b1281d3134ac8b01b657c90ad0d13'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:17.194004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69b1281d3134ac8b01b657c90ad0d13'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:17.194704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69b1281d3134ac8b01b657c90ad0d13'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:17.210086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1133/2295] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:16 2022] DELETE /identity/v3/users/a69b1281d3134ac8b01b657c90ad0d13 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:17.217608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea8e8a-0a05-4014-83f9-1ab9edd68c02 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:17.218456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea8e8a-0a05-4014-83f9-1ab9edd68c02 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:17.218688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea8e8a-0a05-4014-83f9-1ab9edd68c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:17.254498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-efea8e8a-0a05-4014-83f9-1ab9edd68c02 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:17.255911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-efea8e8a-0a05-4014-83f9-1ab9edd68c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:17.302211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:17.335660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1163/2296] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:17.349959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:17.351599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:17.410067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:17.431108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d41e5-50b1-4ddd-a8d5-01e241c2d8ff admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:17.436721 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a60f7f-6048-4678-99e7-95fed56caf7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:17.437461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a60f7f-6048-4678-99e7-95fed56caf7a service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:17.437823 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a60f7f-6048-4678-99e7-95fed56caf7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:17.438250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a60f7f-6048-4678-99e7-95fed56caf7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:17.450150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a60f7f-6048-4678-99e7-95fed56caf7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:17.453101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a60f7f-6048-4678-99e7-95fed56caf7a service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:17.470601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1134/2297] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:17.864087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea8e8a-0a05-4014-83f9-1ab9edd68c02 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:17.867103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-efea8e8a-0a05-4014-83f9-1ab9edd68c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:17.891228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea8e8a-0a05-4014-83f9-1ab9edd68c02 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:17.901220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:17.903169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:17.903666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:17.904153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] PATH_INFO: `/v3/projects/4ad612f09abc4ddca346f8ce30276dfe` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:17.906284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad612f09abc4ddca346f8ce30276dfe)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:17.910043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:17.983775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad612f09abc4ddca346f8ce30276dfe', 'request_id': 'req-69a4c2b9-e66f-4798-9849-1462054e5783'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:17.991021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad612f09abc4ddca346f8ce30276dfe', 'request_id': 'req-69a4c2b9-e66f-4798-9849-1462054e5783'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.001742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad612f09abc4ddca346f8ce30276dfe', 'request_id': 'req-69a4c2b9-e66f-4798-9849-1462054e5783'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.015345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] The token cache is being invalidate because project 4ad612f09abc4ddca346f8ce30276dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:18.015638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.016318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.017863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1164/2298] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:17 2022] DELETE /identity/v3/projects/4ad612f09abc4ddca346f8ce30276dfe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:18.022555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a60f7f-6048-4678-99e7-95fed56caf7a service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:18.034311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a60f7f-6048-4678-99e7-95fed56caf7a service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:18.115804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:18.116100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:18.116394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:18.116663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] PATH_INFO: `/v3/users/c7ec8e4c39304eaa8ace5adc7549b317` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:18.117890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ec8e4c39304eaa8ace5adc7549b317)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:18.119888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:18.180460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ec8e4c39304eaa8ace5adc7549b317'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.181137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ec8e4c39304eaa8ace5adc7549b317'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.194321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ec8e4c39304eaa8ace5adc7549b317'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.205441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ec8e4c39304eaa8ace5adc7549b317'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.206390 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f33a8f0b-6b74-484b-813f-757ca2a103ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ec8e4c39304eaa8ace5adc7549b317'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.221522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1135/2299] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:18 2022] DELETE /identity/v3/users/c7ec8e4c39304eaa8ace5adc7549b317 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:18.671713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:18.674583 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:18.703784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4c2b9-e66f-4798-9849-1462054e5783 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:18.802046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:18.803091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:18.803599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:18.804136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] PATH_INFO: `/v3/projects/7d96f2caff134d5daf7c37ec8a0e996f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:18.806226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d96f2caff134d5daf7c37ec8a0e996f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:18.810535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:18.883866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d96f2caff134d5daf7c37ec8a0e996f', 'request_id': 'req-fd1ee9a7-141d-4aea-b128-3cd8c672e447'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.891919 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d96f2caff134d5daf7c37ec8a0e996f', 'request_id': 'req-fd1ee9a7-141d-4aea-b128-3cd8c672e447'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.905271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d96f2caff134d5daf7c37ec8a0e996f', 'request_id': 'req-fd1ee9a7-141d-4aea-b128-3cd8c672e447'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.906820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:18.923196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] The token cache is being invalidate because project 7d96f2caff134d5daf7c37ec8a0e996f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:18.923583 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.924739 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd1ee9a7-141d-4aea-b128-3cd8c672e447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:18.926824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1165/2300] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:18 2022] DELETE /identity/v3/projects/7d96f2caff134d5daf7c37ec8a0e996f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:18.934507 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e085-d609-424f-befa-e1cc7567b3b4 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:18.934857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e085-d609-424f-befa-e1cc7567b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:18.935267 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672e085-d609-424f-befa-e1cc7567b3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:18.957926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8672e085-d609-424f-befa-e1cc7567b3b4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:18.959908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8672e085-d609-424f-befa-e1cc7567b3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:19.078661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1136/2301] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:19.096435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29a0db-8b7d-43a7-8347-e25b150d6154 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.096761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29a0db-8b7d-43a7-8347-e25b150d6154 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.097002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29a0db-8b7d-43a7-8347-e25b150d6154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.113651 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672e085-d609-424f-befa-e1cc7567b3b4 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:19.116962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8672e085-d609-424f-befa-e1cc7567b3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:19.141901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:19.144732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-be29a0db-8b7d-43a7-8347-e25b150d6154 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:19.147185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-be29a0db-8b7d-43a7-8347-e25b150d6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:19.163538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1166/2302] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:19.168247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29a0db-8b7d-43a7-8347-e25b150d6154 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:19.194190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29a0db-8b7d-43a7-8347-e25b150d6154 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:19.203475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c5d61-8c48-4e9e-9b6c-dcdd32757a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:19.204822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5d61-8c48-4e9e-9b6c-dcdd32757a48 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.205504 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5d61-8c48-4e9e-9b6c-dcdd32757a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.206384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c5d61-8c48-4e9e-9b6c-dcdd32757a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.208591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5d61-8c48-4e9e-9b6c-dcdd32757a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:19.209341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5d61-8c48-4e9e-9b6c-dcdd32757a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:19.213205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c5d61-8c48-4e9e-9b6c-dcdd32757a48 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:19.236021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1167/2303] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:19.242465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c5d61-8c48-4e9e-9b6c-dcdd32757a48 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:19.259633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c5d61-8c48-4e9e-9b6c-dcdd32757a48 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:19.267840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c3f64-bd73-4c26-9b64-3ab10ed5fac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:19.268113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672e085-d609-424f-befa-e1cc7567b3b4 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:19.268465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3f64-bd73-4c26-9b64-3ab10ed5fac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.268788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3f64-bd73-4c26-9b64-3ab10ed5fac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.269227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3f64-bd73-4c26-9b64-3ab10ed5fac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.270324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c3f64-bd73-4c26-9b64-3ab10ed5fac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:19.273957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c3f64-bd73-4c26-9b64-3ab10ed5fac3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:19.277946 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bad7db-0c9c-4148-adfa-3e7af79a5b4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:19.279039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bad7db-0c9c-4148-adfa-3e7af79a5b4c service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.279546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bad7db-0c9c-4148-adfa-3e7af79a5b4c service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.280045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bad7db-0c9c-4148-adfa-3e7af79a5b4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.283007 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-73bad7db-0c9c-4148-adfa-3e7af79a5b4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:19.317806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1168/2304] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:19 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:19.324496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c3f64-bd73-4c26-9b64-3ab10ed5fac3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:19.382681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bad7db-0c9c-4148-adfa-3e7af79a5b4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:19.386157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bad7db-0c9c-4148-adfa-3e7af79a5b4c service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:19.405027 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1137/2305] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:19.405308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c3f64-bd73-4c26-9b64-3ab10ed5fac3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:19.412550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff16bce-4c6a-4126-a35f-0094a50b566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:19.412751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff16bce-4c6a-4126-a35f-0094a50b566e admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.413175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff16bce-4c6a-4126-a35f-0094a50b566e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.413689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff16bce-4c6a-4126-a35f-0094a50b566e admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.414927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff16bce-4c6a-4126-a35f-0094a50b566e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:19.418348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff16bce-4c6a-4126-a35f-0094a50b566e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:19.474344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1169/2306] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:19 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:19.483798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bad7db-0c9c-4148-adfa-3e7af79a5b4c service nova] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:19.501772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bad7db-0c9c-4148-adfa-3e7af79a5b4c service nova] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:19.508617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3eef4f-01f3-4097-bd8b-5309b2c6985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:19.509402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eef4f-01f3-4097-bd8b-5309b2c6985a admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.509803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eef4f-01f3-4097-bd8b-5309b2c6985a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.510218 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3eef4f-01f3-4097-bd8b-5309b2c6985a admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.511622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eef4f-01f3-4097-bd8b-5309b2c6985a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:19.513466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3eef4f-01f3-4097-bd8b-5309b2c6985a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:19.530665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1138/2307] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:19.538306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff16bce-4c6a-4126-a35f-0094a50b566e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:19.556033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff16bce-4c6a-4126-a35f-0094a50b566e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:19.563520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d4fe3-b648-47a7-9002-673364428626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:19.564505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d4fe3-b648-47a7-9002-673364428626 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.564956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d4fe3-b648-47a7-9002-673364428626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.565603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d4fe3-b648-47a7-9002-673364428626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.566465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d4fe3-b648-47a7-9002-673364428626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:19.568797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d4fe3-b648-47a7-9002-673364428626 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:19.587727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1170/2308] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:19.594224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3eef4f-01f3-4097-bd8b-5309b2c6985a admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:19.610575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3eef4f-01f3-4097-bd8b-5309b2c6985a admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:19.617538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d063-ea2b-4a57-9222-dc71fa1ffce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:19.618612 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d063-ea2b-4a57-9222-dc71fa1ffce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.619120 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d063-ea2b-4a57-9222-dc71fa1ffce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.619566 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d063-ea2b-4a57-9222-dc71fa1ffce2 admin admin] PATH_INFO: `/v3/projects/860eba03f17b495da2b049eedcb289eb/users/d87c650e0fc54518a9600082965cdc69/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.652736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833d063-ea2b-4a57-9222-dc71fa1ffce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860eba03f17b495da2b049eedcb289eb, user_id=d87c650e0fc54518a9600082965cdc69, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:19.657111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833d063-ea2b-4a57-9222-dc71fa1ffce2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:19.686703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1139/2309] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:19 2022] PUT /identity/v3/projects/860eba03f17b495da2b049eedcb289eb/users/d87c650e0fc54518a9600082965cdc69/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:19.693934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40a3fd-94e7-48fa-b466-a460bfadc087 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.694654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40a3fd-94e7-48fa-b466-a460bfadc087 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.694896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40a3fd-94e7-48fa-b466-a460bfadc087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.756753 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3b40a3fd-94e7-48fa-b466-a460bfadc087 None None] MFA Rules not processed for user `d87c650e0fc54518a9600082965cdc69`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:19.759276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3b40a3fd-94e7-48fa-b466-a460bfadc087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:19.894999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1171/2310] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:19.897454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d063-ea2b-4a57-9222-dc71fa1ffce2 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:19.988598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d063-ea2b-4a57-9222-dc71fa1ffce2 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:19.997294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054ff27-76cf-4696-8810-ca9f4249e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:19.997985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054ff27-76cf-4696-8810-ca9f4249e080 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:19.998364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054ff27-76cf-4696-8810-ca9f4249e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:19.998742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054ff27-76cf-4696-8810-ca9f4249e080 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:19.999569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054ff27-76cf-4696-8810-ca9f4249e080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:20.001920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054ff27-76cf-4696-8810-ca9f4249e080 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:20.027945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:20.049684 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1140/2311] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:19 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:20.054386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40a3fd-94e7-48fa-b466-a460bfadc087 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:20.068635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40a3fd-94e7-48fa-b466-a460bfadc087 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:20.090785 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:20.145925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef82e8d-f411-45cb-a1e8-4995db52cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:20.146776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82e8d-f411-45cb-a1e8-4995db52cba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:20.147189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82e8d-f411-45cb-a1e8-4995db52cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:20.147601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef82e8d-f411-45cb-a1e8-4995db52cba8 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:20.148309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef82e8d-f411-45cb-a1e8-4995db52cba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:20.150476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef82e8d-f411-45cb-a1e8-4995db52cba8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:20.175055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1172/2312] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:20 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:20.180672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054ff27-76cf-4696-8810-ca9f4249e080 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:20.192827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054ff27-76cf-4696-8810-ca9f4249e080 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:20.197899 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444ff2e-19b4-402a-806b-ffb725c60d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:20.198546 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ff2e-19b4-402a-806b-ffb725c60d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:20.198854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ff2e-19b4-402a-806b-ffb725c60d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:20.199173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ff2e-19b4-402a-806b-ffb725c60d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:20.199838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444ff2e-19b4-402a-806b-ffb725c60d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:20.201511 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444ff2e-19b4-402a-806b-ffb725c60d34 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:20.217812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1141/2313] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:20.222395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef82e8d-f411-45cb-a1e8-4995db52cba8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:20.236165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef82e8d-f411-45cb-a1e8-4995db52cba8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:20.244138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759869d4-8b49-4681-9d85-2d46ba38f531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:20.245233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759869d4-8b49-4681-9d85-2d46ba38f531 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:20.245760 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759869d4-8b49-4681-9d85-2d46ba38f531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:20.246239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759869d4-8b49-4681-9d85-2d46ba38f531 admin admin] PATH_INFO: `/v3/projects/f95b3d334c344d50b3a2361e13c83720/users/86992995e4ba4b8783210f6da5e3dc87/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:20.273240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759869d4-8b49-4681-9d85-2d46ba38f531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95b3d334c344d50b3a2361e13c83720, user_id=86992995e4ba4b8783210f6da5e3dc87, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:20.279455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759869d4-8b49-4681-9d85-2d46ba38f531 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:20.301995 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1173/2314] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:20 2022] PUT /identity/v3/projects/f95b3d334c344d50b3a2361e13c83720/users/86992995e4ba4b8783210f6da5e3dc87/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:20.307134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444ff2e-19b4-402a-806b-ffb725c60d34 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:20.319025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444ff2e-19b4-402a-806b-ffb725c60d34 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:20.410451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd068f-f7a2-402e-8602-1e90a0b24037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:20.411465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd068f-f7a2-402e-8602-1e90a0b24037 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:20.415079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd068f-f7a2-402e-8602-1e90a0b24037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:20.415079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd068f-f7a2-402e-8602-1e90a0b24037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:20.415079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd068f-f7a2-402e-8602-1e90a0b24037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:20.415808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd068f-f7a2-402e-8602-1e90a0b24037 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:20.433113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1142/2315] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:20.438422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759869d4-8b49-4681-9d85-2d46ba38f531 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:20.458728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759869d4-8b49-4681-9d85-2d46ba38f531 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:20.469375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9057e-deb0-4204-b0cc-a3d7f3630a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:20.470713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9057e-deb0-4204-b0cc-a3d7f3630a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:20.471286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9057e-deb0-4204-b0cc-a3d7f3630a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:20.471776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9057e-deb0-4204-b0cc-a3d7f3630a79 admin admin] PATH_INFO: `/v3/projects/f95b3d334c344d50b3a2361e13c83720/users/86992995e4ba4b8783210f6da5e3dc87/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:20.476354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9057e-deb0-4204-b0cc-a3d7f3630a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95b3d334c344d50b3a2361e13c83720, user_id=86992995e4ba4b8783210f6da5e3dc87, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:20.483399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9057e-deb0-4204-b0cc-a3d7f3630a79 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:20.505767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1174/2316] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:20 2022] PUT /identity/v3/projects/f95b3d334c344d50b3a2361e13c83720/users/86992995e4ba4b8783210f6da5e3dc87/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:20.522707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06137c-5d21-43c4-9b87-4762ae19d4d8 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:20.523193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06137c-5d21-43c4-9b87-4762ae19d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:20.523623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06137c-5d21-43c4-9b87-4762ae19d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:20.568206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ff06137c-5d21-43c4-9b87-4762ae19d4d8 None None] MFA Rules not processed for user `86992995e4ba4b8783210f6da5e3dc87`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:20.570080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ff06137c-5d21-43c4-9b87-4762ae19d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:20.608170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9057e-deb0-4204-b0cc-a3d7f3630a79 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:20.610541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c4c9057e-deb0-4204-b0cc-a3d7f3630a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:20.704845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1143/2317] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:20.724325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06137c-5d21-43c4-9b87-4762ae19d4d8 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:20.727108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ff06137c-5d21-43c4-9b87-4762ae19d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:20.765708 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9057e-deb0-4204-b0cc-a3d7f3630a79 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:20.775772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:20.776319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:20.776820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:20.777065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:20.779550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:20.794585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:20.796251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:20.806016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06137c-5d21-43c4-9b87-4762ae19d4d8 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:20.809987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1175/2318] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:46:20.812780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a9cd-9e64-4abd-b5a1-87dd3d1bd30f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:20.813525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a9cd-9e64-4abd-b5a1-87dd3d1bd30f service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:20.813900 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a9cd-9e64-4abd-b5a1-87dd3d1bd30f service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:20.814295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a9cd-9e64-4abd-b5a1-87dd3d1bd30f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:20.831245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946a9cd-9e64-4abd-b5a1-87dd3d1bd30f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:20.832985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946a9cd-9e64-4abd-b5a1-87dd3d1bd30f service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:20.848693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1144/2319] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:46:20.976990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:20.979379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:21.013982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9e04-a934-4cfe-a6e6-d7f0c6189156 service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:21.021608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b97de-6008-4158-9964-48eb31fd861a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:21.022840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b97de-6008-4158-9964-48eb31fd861a service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:21.023628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b97de-6008-4158-9964-48eb31fd861a service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:21.024214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b97de-6008-4158-9964-48eb31fd861a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:21.142011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:21.149267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b97de-6008-4158-9964-48eb31fd861a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:21.151300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b97de-6008-4158-9964-48eb31fd861a service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:21.162654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1176/2320] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:27.041712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a9cd-9e64-4abd-b5a1-87dd3d1bd30f service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:27.057568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:27.133821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a9cd-9e64-4abd-b5a1-87dd3d1bd30f service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:27.152681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:27.153924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:27.154326 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:27.154897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] PATH_INFO: `/v3/users/d87c650e0fc54518a9600082965cdc69` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:27.157534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87c650e0fc54518a9600082965cdc69)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:27.161755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:27.256618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87c650e0fc54518a9600082965cdc69'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:27.257579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87c650e0fc54518a9600082965cdc69'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:27.275790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87c650e0fc54518a9600082965cdc69'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:27.285957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87c650e0fc54518a9600082965cdc69'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:27.287204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87c650e0fc54518a9600082965cdc69'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:27.312268 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1145/2321] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:27 2022] DELETE /identity/v3/users/d87c650e0fc54518a9600082965cdc69 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:27.317641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1edb-7e0b-4d7d-afb9-eb84097682ca None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:27.318493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1edb-7e0b-4d7d-afb9-eb84097682ca None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:27.318676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1edb-7e0b-4d7d-afb9-eb84097682ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:27.345175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-44ef1edb-7e0b-4d7d-afb9-eb84097682ca None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:27.346839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-44ef1edb-7e0b-4d7d-afb9-eb84097682ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:27.426911 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1177/2322] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:27.442552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:27.444997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:27.515597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2174-4228-4f38-bb53-453d95e31aa6 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:27.519493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e56be3-5757-4622-96d8-b7ef310146c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:27.520091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e56be3-5757-4622-96d8-b7ef310146c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:27.520370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e56be3-5757-4622-96d8-b7ef310146c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:27.520643 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e56be3-5757-4622-96d8-b7ef310146c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:27.532984 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e56be3-5757-4622-96d8-b7ef310146c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:27.534431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e56be3-5757-4622-96d8-b7ef310146c3 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:27.547867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1146/2323] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:27.889610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1edb-7e0b-4d7d-afb9-eb84097682ca None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:27.890823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-44ef1edb-7e0b-4d7d-afb9-eb84097682ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:27.908396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1edb-7e0b-4d7d-afb9-eb84097682ca None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:27.914121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:27.914804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:27.915139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:27.915424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] PATH_INFO: `/v3/projects/860eba03f17b495da2b049eedcb289eb` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:27.916784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=860eba03f17b495da2b049eedcb289eb)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:27.918810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:27.986537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860eba03f17b495da2b049eedcb289eb', 'request_id': 'req-338a98a8-017b-4f07-ba50-e627b3567605'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:27.998300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860eba03f17b495da2b049eedcb289eb', 'request_id': 'req-338a98a8-017b-4f07-ba50-e627b3567605'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.012714 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860eba03f17b495da2b049eedcb289eb', 'request_id': 'req-338a98a8-017b-4f07-ba50-e627b3567605'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.026546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] The token cache is being invalidate because project 860eba03f17b495da2b049eedcb289eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:28.027789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.028523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.030287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1178/2324] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:27 2022] DELETE /identity/v3/projects/860eba03f17b495da2b049eedcb289eb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:28.035424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e56be3-5757-4622-96d8-b7ef310146c3 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:28.045646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e56be3-5757-4622-96d8-b7ef310146c3 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:28.098075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:28.144338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:28.145095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:28.145380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:28.145976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] PATH_INFO: `/v3/users/86992995e4ba4b8783210f6da5e3dc87` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:28.147260 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86992995e4ba4b8783210f6da5e3dc87)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:28.149342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:28.206035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86992995e4ba4b8783210f6da5e3dc87'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.206724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86992995e4ba4b8783210f6da5e3dc87'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.225697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86992995e4ba4b8783210f6da5e3dc87'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.235276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86992995e4ba4b8783210f6da5e3dc87'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.236075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3677018c-7eb8-42f2-8999-12b16e5316e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86992995e4ba4b8783210f6da5e3dc87'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.263538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1147/2325] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:28 2022] DELETE /identity/v3/users/86992995e4ba4b8783210f6da5e3dc87 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:28.585493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:28.588100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:28.606066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a98a8-017b-4f07-ba50-e627b3567605 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:28.677325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:28.677914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:28.678197 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:28.678476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] PATH_INFO: `/v3/projects/f95b3d334c344d50b3a2361e13c83720` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:28.679674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95b3d334c344d50b3a2361e13c83720)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:28.681661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:28.708840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:28.738829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95b3d334c344d50b3a2361e13c83720', 'request_id': 'req-26022261-4f41-476e-af38-fdbd7f0da1f7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.744657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95b3d334c344d50b3a2361e13c83720', 'request_id': 'req-26022261-4f41-476e-af38-fdbd7f0da1f7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.756662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95b3d334c344d50b3a2361e13c83720', 'request_id': 'req-26022261-4f41-476e-af38-fdbd7f0da1f7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.770010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] The token cache is being invalidate because project f95b3d334c344d50b3a2361e13c83720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:28.770300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.770982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-26022261-4f41-476e-af38-fdbd7f0da1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:28.772476 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1179/2326] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:28 2022] DELETE /identity/v3/projects/f95b3d334c344d50b3a2361e13c83720 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:46:28.778119 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629922-e948-4d39-b529-fe80bddb4c7b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:28.778511 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629922-e948-4d39-b529-fe80bddb4c7b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:28.778850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629922-e948-4d39-b529-fe80bddb4c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:28.800889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-bc629922-e948-4d39-b529-fe80bddb4c7b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:28.802129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bc629922-e948-4d39-b529-fe80bddb4c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:28.875882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1148/2327] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:28.884366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe47e-3dbb-4cd0-b481-8b1b3ddbd676 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:28.884706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe47e-3dbb-4cd0-b481-8b1b3ddbd676 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:28.885010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fe47e-3dbb-4cd0-b481-8b1b3ddbd676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:28.913642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3e3fe47e-3dbb-4cd0-b481-8b1b3ddbd676 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:28.914843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3e3fe47e-3dbb-4cd0-b481-8b1b3ddbd676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:28.925467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1180/2328] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:28.930371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629922-e948-4d39-b529-fe80bddb4c7b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:28.940796 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629922-e948-4d39-b529-fe80bddb4c7b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:28.948908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1ec9f-ffdc-4f6d-9890-df96203a0c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:28.949678 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1ec9f-ffdc-4f6d-9890-df96203a0c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:28.949960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1ec9f-ffdc-4f6d-9890-df96203a0c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:28.950234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1ec9f-ffdc-4f6d-9890-df96203a0c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:28.950913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1ec9f-ffdc-4f6d-9890-df96203a0c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:28.951250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1ec9f-ffdc-4f6d-9890-df96203a0c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:28.952938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1ec9f-ffdc-4f6d-9890-df96203a0c4a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:28.971066 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1149/2329] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:28.972330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fe47e-3dbb-4cd0-b481-8b1b3ddbd676 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:28.988813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fe47e-3dbb-4cd0-b481-8b1b3ddbd676 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:28.993867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93998de7-5de2-49ae-bb7a-37660b4eba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:28.994485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93998de7-5de2-49ae-bb7a-37660b4eba60 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:28.994770 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93998de7-5de2-49ae-bb7a-37660b4eba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:28.995077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93998de7-5de2-49ae-bb7a-37660b4eba60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:28.996279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93998de7-5de2-49ae-bb7a-37660b4eba60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:28.998246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93998de7-5de2-49ae-bb7a-37660b4eba60 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:29.030826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1181/2330] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:28 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:29.035216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1ec9f-ffdc-4f6d-9890-df96203a0c4a admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:29.047083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1ec9f-ffdc-4f6d-9890-df96203a0c4a admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:29.084983 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:29.114028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a1879-eefa-4f0b-839e-97dc77488b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:29.114641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1879-eefa-4f0b-839e-97dc77488b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:29.114956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1879-eefa-4f0b-839e-97dc77488b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:29.115239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1879-eefa-4f0b-839e-97dc77488b43 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:29.116073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a1879-eefa-4f0b-839e-97dc77488b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:29.117809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a1879-eefa-4f0b-839e-97dc77488b43 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:29.140602 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1150/2331] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:29 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:29.144850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93998de7-5de2-49ae-bb7a-37660b4eba60 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:29.156726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93998de7-5de2-49ae-bb7a-37660b4eba60 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:29.161930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edbbb3-0b67-42ba-88bc-79f698530669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:29.162906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edbbb3-0b67-42ba-88bc-79f698530669 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:29.162906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edbbb3-0b67-42ba-88bc-79f698530669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:29.163398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edbbb3-0b67-42ba-88bc-79f698530669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:29.164069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edbbb3-0b67-42ba-88bc-79f698530669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:29.165696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edbbb3-0b67-42ba-88bc-79f698530669 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:29.177433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1182/2332] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:29.181806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a1879-eefa-4f0b-839e-97dc77488b43 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:29.192995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a1879-eefa-4f0b-839e-97dc77488b43 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:29.198682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3674b-de8a-460a-a4ac-2dfd0e16cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:29.199385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3674b-de8a-460a-a4ac-2dfd0e16cff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:29.199659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3674b-de8a-460a-a4ac-2dfd0e16cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:29.199927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3674b-de8a-460a-a4ac-2dfd0e16cff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:29.200582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3674b-de8a-460a-a4ac-2dfd0e16cff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:29.202223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3674b-de8a-460a-a4ac-2dfd0e16cff2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:29.213720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1151/2333] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:29.219018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edbbb3-0b67-42ba-88bc-79f698530669 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:29.231635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edbbb3-0b67-42ba-88bc-79f698530669 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:29.237550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba4d41-c5f2-4bb8-8a45-fbba5fc8da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:29.238304 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4d41-c5f2-4bb8-8a45-fbba5fc8da5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:29.238628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4d41-c5f2-4bb8-8a45-fbba5fc8da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:29.238897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4d41-c5f2-4bb8-8a45-fbba5fc8da5a admin admin] PATH_INFO: `/v3/projects/5f110a129d054198a118513266342862/users/7d6d0a6ac52a4a25917e2c166ed2c4b3/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:29.259832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba4d41-c5f2-4bb8-8a45-fbba5fc8da5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f110a129d054198a118513266342862, user_id=7d6d0a6ac52a4a25917e2c166ed2c4b3, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:29.263328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba4d41-c5f2-4bb8-8a45-fbba5fc8da5a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:29.282870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1183/2334] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:29 2022] PUT /identity/v3/projects/5f110a129d054198a118513266342862/users/7d6d0a6ac52a4a25917e2c166ed2c4b3/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:29.295985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9def88-393e-4978-b071-869cb8f53869 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:29.296640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9def88-393e-4978-b071-869cb8f53869 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:29.296848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9def88-393e-4978-b071-869cb8f53869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:29.332968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1e9def88-393e-4978-b071-869cb8f53869 None None] MFA Rules not processed for user `7d6d0a6ac52a4a25917e2c166ed2c4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:29.334403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1e9def88-393e-4978-b071-869cb8f53869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:29.415293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1152/2335] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:29.427817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba4d41-c5f2-4bb8-8a45-fbba5fc8da5a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:29.430324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-59ba4d41-c5f2-4bb8-8a45-fbba5fc8da5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:29.519801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba4d41-c5f2-4bb8-8a45-fbba5fc8da5a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:29.523931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148ded-54a7-4808-9b8c-81d54a389491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:29.524553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148ded-54a7-4808-9b8c-81d54a389491 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:29.524834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148ded-54a7-4808-9b8c-81d54a389491 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:29.525110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148ded-54a7-4808-9b8c-81d54a389491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:29.535312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20148ded-54a7-4808-9b8c-81d54a389491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:29.536768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20148ded-54a7-4808-9b8c-81d54a389491 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:29.547356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1184/2336] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:31.646471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd87f38-cd7a-4424-8b62-f4832b923b17 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.647275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd87f38-cd7a-4424-8b62-f4832b923b17 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.647275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd87f38-cd7a-4424-8b62-f4832b923b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.668286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ccd87f38-cd7a-4424-8b62-f4832b923b17 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:31.669506 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ccd87f38-cd7a-4424-8b62-f4832b923b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:31.738258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1153/2337] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:31.810630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148ded-54a7-4808-9b8c-81d54a389491 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:31.811322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-20148ded-54a7-4808-9b8c-81d54a389491 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:31.873741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:31.898044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148ded-54a7-4808-9b8c-81d54a389491 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:31.904772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32b562-e751-42f4-8319-36e6a43e04c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:31.905430 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b562-e751-42f4-8319-36e6a43e04c5 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:31.905706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b562-e751-42f4-8319-36e6a43e04c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:31.905982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32b562-e751-42f4-8319-36e6a43e04c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:31.919148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32b562-e751-42f4-8319-36e6a43e04c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:31.920775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32b562-e751-42f4-8319-36e6a43e04c5 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:31.930024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1185/2338] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:46:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:46:41.729321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:41.926391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=10 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:43.827235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd87f38-cd7a-4424-8b62-f4832b923b17 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:43.921998 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd87f38-cd7a-4424-8b62-f4832b923b17 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:43.926830 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:43.927724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:43.928003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:43.928286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] PATH_INFO: `/v3/users/7d6d0a6ac52a4a25917e2c166ed2c4b3` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:43.929517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6d0a6ac52a4a25917e2c166ed2c4b3)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:43.931542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:44.003469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6d0a6ac52a4a25917e2c166ed2c4b3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.004219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6d0a6ac52a4a25917e2c166ed2c4b3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.020603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6d0a6ac52a4a25917e2c166ed2c4b3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.037961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6d0a6ac52a4a25917e2c166ed2c4b3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.039085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6d0a6ac52a4a25917e2c166ed2c4b3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.061747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1154/2339] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:43 2022] DELETE /identity/v3/users/7d6d0a6ac52a4a25917e2c166ed2c4b3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:44.067900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94241953-c172-4fe1-97e0-5056cb2a7dce None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:44.069068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94241953-c172-4fe1-97e0-5056cb2a7dce None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:44.069068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94241953-c172-4fe1-97e0-5056cb2a7dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:44.091969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-94241953-c172-4fe1-97e0-5056cb2a7dce None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:44.093486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-94241953-c172-4fe1-97e0-5056cb2a7dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:44.190100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1186/2340] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:44.200498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:44.202212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:44.270953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacf91d-a9d5-4db5-b478-bea564f278c5 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:44.276365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d2bdd-f77d-405b-b2c0-3423d0285fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:44.278002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2bdd-f77d-405b-b2c0-3423d0285fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:44.278344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2bdd-f77d-405b-b2c0-3423d0285fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:44.278682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2bdd-f77d-405b-b2c0-3423d0285fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:44.290441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d2bdd-f77d-405b-b2c0-3423d0285fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:44.292011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d2bdd-f77d-405b-b2c0-3423d0285fa6 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:44.303618 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1155/2341] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:44.687534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94241953-c172-4fe1-97e0-5056cb2a7dce None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:44.689004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-94241953-c172-4fe1-97e0-5056cb2a7dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:44.702136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94241953-c172-4fe1-97e0-5056cb2a7dce None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:44.706766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:44.707649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:44.707932 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:44.708339 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] PATH_INFO: `/v3/projects/5f110a129d054198a118513266342862` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:44.709756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f110a129d054198a118513266342862)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:44.711936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:44.766034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f110a129d054198a118513266342862', 'request_id': 'req-3b818e31-1e7a-43ee-8957-495dbc2f19d6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.773202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f110a129d054198a118513266342862', 'request_id': 'req-3b818e31-1e7a-43ee-8957-495dbc2f19d6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.788370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f110a129d054198a118513266342862', 'request_id': 'req-3b818e31-1e7a-43ee-8957-495dbc2f19d6'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.806630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] The token cache is being invalidate because project 5f110a129d054198a118513266342862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:44.806975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.807888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:44.809916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1187/2342] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:44 2022] DELETE /identity/v3/projects/5f110a129d054198a118513266342862 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:44.815084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff7ec-d385-4dbc-adc7-cbf4504fc1f0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:44.815257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff7ec-d385-4dbc-adc7-cbf4504fc1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:44.815563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff7ec-d385-4dbc-adc7-cbf4504fc1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:44.837064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-880ff7ec-d385-4dbc-adc7-cbf4504fc1f0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:44.838784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-880ff7ec-d385-4dbc-adc7-cbf4504fc1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:44.846678 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:44.848339 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:44.861497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:44.909809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1156/2343] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:44.912860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b818e31-1e7a-43ee-8957-495dbc2f19d6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:44.916756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749eedc-b4ea-43b6-8311-1fa420a0ddce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:44.917396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749eedc-b4ea-43b6-8311-1fa420a0ddce service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:44.917676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749eedc-b4ea-43b6-8311-1fa420a0ddce service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:44.917956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749eedc-b4ea-43b6-8311-1fa420a0ddce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:44.918432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09205ffb-6c7d-4988-85b1-28b1df98b57c None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:44.918723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09205ffb-6c7d-4988-85b1-28b1df98b57c None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:44.919029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09205ffb-6c7d-4988-85b1-28b1df98b57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:44.919979 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5749eedc-b4ea-43b6-8311-1fa420a0ddce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:44.932929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749eedc-b4ea-43b6-8311-1fa420a0ddce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:44.934894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749eedc-b4ea-43b6-8311-1fa420a0ddce service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:44.939105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-09205ffb-6c7d-4988-85b1-28b1df98b57c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:44.940289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-09205ffb-6c7d-4988-85b1-28b1df98b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:44.945002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1188/2344] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:46:44.950592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1157/2345] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:44.954860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749eedc-b4ea-43b6-8311-1fa420a0ddce service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:44.965838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749eedc-b4ea-43b6-8311-1fa420a0ddce service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:44.970546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08617a1-e2e9-4ff3-b82f-de6bced24918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:44.971170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08617a1-e2e9-4ff3-b82f-de6bced24918 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:44.971451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08617a1-e2e9-4ff3-b82f-de6bced24918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:44.971724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08617a1-e2e9-4ff3-b82f-de6bced24918 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:44.972378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08617a1-e2e9-4ff3-b82f-de6bced24918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:44.972683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08617a1-e2e9-4ff3-b82f-de6bced24918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:44.974412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08617a1-e2e9-4ff3-b82f-de6bced24918 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:44.987623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1189/2346] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:44.992034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09205ffb-6c7d-4988-85b1-28b1df98b57c None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:45.002072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09205ffb-6c7d-4988-85b1-28b1df98b57c None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:45.007116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3c40b-fb3a-4295-bbf5-3d52dcb53768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:45.007876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3c40b-fb3a-4295-bbf5-3d52dcb53768 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:45.008320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3c40b-fb3a-4295-bbf5-3d52dcb53768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:45.008741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3c40b-fb3a-4295-bbf5-3d52dcb53768 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:45.009439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3c40b-fb3a-4295-bbf5-3d52dcb53768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:45.012296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3c40b-fb3a-4295-bbf5-3d52dcb53768 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:45.046319 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1158/2347] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:44 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:45.047541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08617a1-e2e9-4ff3-b82f-de6bced24918 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:45.057843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08617a1-e2e9-4ff3-b82f-de6bced24918 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:45.067865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:45.123965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaae82f-aead-4b96-9bc7-fd227bf18e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:45.124659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaae82f-aead-4b96-9bc7-fd227bf18e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:45.124849 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaae82f-aead-4b96-9bc7-fd227bf18e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:45.125277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaae82f-aead-4b96-9bc7-fd227bf18e10 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:45.125909 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaae82f-aead-4b96-9bc7-fd227bf18e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:45.127885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaae82f-aead-4b96-9bc7-fd227bf18e10 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:45.153517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1190/2348] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:45 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:45.157917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3c40b-fb3a-4295-bbf5-3d52dcb53768 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:45.169380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3c40b-fb3a-4295-bbf5-3d52dcb53768 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:45.174360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a2f5-aef6-4ffe-85bd-ff46a4c52ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:45.175012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a2f5-aef6-4ffe-85bd-ff46a4c52ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:45.175300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a2f5-aef6-4ffe-85bd-ff46a4c52ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:45.175575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a2f5-aef6-4ffe-85bd-ff46a4c52ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:45.176243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0a2f5-aef6-4ffe-85bd-ff46a4c52ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:45.177924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0a2f5-aef6-4ffe-85bd-ff46a4c52ef1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:45.190731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1159/2349] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:45.195023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaae82f-aead-4b96-9bc7-fd227bf18e10 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:45.206252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaae82f-aead-4b96-9bc7-fd227bf18e10 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:45.211857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff11ea-54c0-4629-927a-1ecefa387d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:45.212496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff11ea-54c0-4629-927a-1ecefa387d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:45.212860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff11ea-54c0-4629-927a-1ecefa387d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:45.213055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff11ea-54c0-4629-927a-1ecefa387d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:45.213719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff11ea-54c0-4629-927a-1ecefa387d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:45.216097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff11ea-54c0-4629-927a-1ecefa387d89 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:45.228370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1191/2350] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:45.232545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a2f5-aef6-4ffe-85bd-ff46a4c52ef1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:45.244571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a2f5-aef6-4ffe-85bd-ff46a4c52ef1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:45.250127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b70e32-0d4e-40de-8013-8e4beeb4e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:45.250819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70e32-0d4e-40de-8013-8e4beeb4e267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:45.251134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70e32-0d4e-40de-8013-8e4beeb4e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:45.251409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70e32-0d4e-40de-8013-8e4beeb4e267 admin admin] PATH_INFO: `/v3/projects/065d3513f5a743ea9c62fad84c517114/users/c1b5256e7ccb438c8ed3549cb4e1f185/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:45.269195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b70e32-0d4e-40de-8013-8e4beeb4e267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065d3513f5a743ea9c62fad84c517114, user_id=c1b5256e7ccb438c8ed3549cb4e1f185, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:45.272028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b70e32-0d4e-40de-8013-8e4beeb4e267 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:45.289168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1160/2351] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:45 2022] PUT /identity/v3/projects/065d3513f5a743ea9c62fad84c517114/users/c1b5256e7ccb438c8ed3549cb4e1f185/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:45.301878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444e25-8552-4151-bd43-e1e1616825f4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:45.302142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444e25-8552-4151-bd43-e1e1616825f4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:45.302417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444e25-8552-4151-bd43-e1e1616825f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:45.333217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-22444e25-8552-4151-bd43-e1e1616825f4 None None] MFA Rules not processed for user `c1b5256e7ccb438c8ed3549cb4e1f185`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:45.334353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-22444e25-8552-4151-bd43-e1e1616825f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:45.402200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1192/2352] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:45.414135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b70e32-0d4e-40de-8013-8e4beeb4e267 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:45.415992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-67b70e32-0d4e-40de-8013-8e4beeb4e267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:45.476768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b70e32-0d4e-40de-8013-8e4beeb4e267 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:45.480666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453c8c8-310f-462a-8832-106eae71d4a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:45.481314 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453c8c8-310f-462a-8832-106eae71d4a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:45.481592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453c8c8-310f-462a-8832-106eae71d4a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:45.481865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453c8c8-310f-462a-8832-106eae71d4a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:45.491657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453c8c8-310f-462a-8832-106eae71d4a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:45.493126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453c8c8-310f-462a-8832-106eae71d4a2 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:45.504760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1161/2353] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:48.413177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c66ef-e501-413f-ba90-315e4e654926 None None] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:48.413785 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c66ef-e501-413f-ba90-315e4e654926 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:48.414004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c66ef-e501-413f-ba90-315e4e654926 None None] PATH_INFO: `/` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:48.416397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1193/2354] 10.222.0.89 () {54 vars in 921 bytes} [Fri Aug 26 15:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 15:46:48.422986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c330c-3471-40fd-86f2-17c304c72b83 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:48.424121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c330c-3471-40fd-86f2-17c304c72b83 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:48.424729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c330c-3471-40fd-86f2-17c304c72b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:48.474449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-0c7c330c-3471-40fd-86f2-17c304c72b83 None None] MFA Rules not processed for user `5cbda75c38b04e6c89f17e655eb4f737`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:48.475798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-0c7c330c-3471-40fd-86f2-17c304c72b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:48.564179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:48.592892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1162/2355] 10.222.0.89 () {58 vars in 1018 bytes} [Fri Aug 26 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:48.614533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c66ef-e501-413f-ba90-315e4e654926 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:48.616857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b11c66ef-e501-413f-ba90-315e4e654926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:48.753757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c66ef-e501-413f-ba90-315e4e654926 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:48.760065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cac5d-3ea2-4ba3-b913-d79a72270998 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d055337c9a642bd9b8b5a60aacb11cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:48.761716 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cac5d-3ea2-4ba3-b913-d79a72270998 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:48.762776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cac5d-3ea2-4ba3-b913-d79a72270998 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:48.763522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cac5d-3ea2-4ba3-b913-d79a72270998 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:48.802721 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cac5d-3ea2-4ba3-b913-d79a72270998 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:48.804439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cac5d-3ea2-4ba3-b913-d79a72270998 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:48.817487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1194/2356] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:49.411624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c330c-3471-40fd-86f2-17c304c72b83 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:49.415601 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-0c7c330c-3471-40fd-86f2-17c304c72b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:49.494050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c330c-3471-40fd-86f2-17c304c72b83 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:49.500332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:49.501266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:49.501574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:49.502061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] PATH_INFO: `/v3/users/91137d4fc46f401aa969752a5adf176f` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:49.503337 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91137d4fc46f401aa969752a5adf176f)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:49.505296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:49.563306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91137d4fc46f401aa969752a5adf176f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.563977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91137d4fc46f401aa969752a5adf176f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.580761 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91137d4fc46f401aa969752a5adf176f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.589266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91137d4fc46f401aa969752a5adf176f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.590819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c24fcc3b-2719-43d6-9fe1-4759e0327e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91137d4fc46f401aa969752a5adf176f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:49.605790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1163/2357] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:49 2022] DELETE /identity/v3/users/91137d4fc46f401aa969752a5adf176f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:49.845003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cac5d-3ea2-4ba3-b913-d79a72270998 service glance] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:49.873395 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cac5d-3ea2-4ba3-b913-d79a72270998 service glance] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:49.922027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:50.017543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:50.022541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.022875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.023455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] PATH_INFO: `/v3/projects/df305cf338a14da9898a35467de2811d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.026046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df305cf338a14da9898a35467de2811d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:50.029833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:50.108397 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df305cf338a14da9898a35467de2811d', 'request_id': 'req-2d0166ba-f664-4c45-ad16-74c488ce0b37'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:50.114863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df305cf338a14da9898a35467de2811d', 'request_id': 'req-2d0166ba-f664-4c45-ad16-74c488ce0b37'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:50.124429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df305cf338a14da9898a35467de2811d', 'request_id': 'req-2d0166ba-f664-4c45-ad16-74c488ce0b37'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:50.137107 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] The token cache is being invalidate because project df305cf338a14da9898a35467de2811d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:50.137399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:50.138056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d0166ba-f664-4c45-ad16-74c488ce0b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:50.139585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1195/2358] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:49 2022] DELETE /identity/v3/projects/df305cf338a14da9898a35467de2811d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:50.145154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1e510-0f1b-4881-87d6-94e077ca0175 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.145293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1e510-0f1b-4881-87d6-94e077ca0175 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.145913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1e510-0f1b-4881-87d6-94e077ca0175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.170264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-dac1e510-0f1b-4881-87d6-94e077ca0175 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:50.171692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-dac1e510-0f1b-4881-87d6-94e077ca0175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:50.253597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1164/2359] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:50.262542 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348404a-fc96-4324-8fc4-689672172735 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.262831 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348404a-fc96-4324-8fc4-689672172735 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.263138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348404a-fc96-4324-8fc4-689672172735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.283523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7348404a-fc96-4324-8fc4-689672172735 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:50.284728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7348404a-fc96-4324-8fc4-689672172735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:50.293198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1196/2360] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:50.297659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1e510-0f1b-4881-87d6-94e077ca0175 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:50.307575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1e510-0f1b-4881-87d6-94e077ca0175 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:50.313056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e4b7f-26a3-4c7e-b04c-888463a2e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:50.313697 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e4b7f-26a3-4c7e-b04c-888463a2e964 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.313979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e4b7f-26a3-4c7e-b04c-888463a2e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.314250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e4b7f-26a3-4c7e-b04c-888463a2e964 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.314901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e4b7f-26a3-4c7e-b04c-888463a2e964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:50.315241 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e4b7f-26a3-4c7e-b04c-888463a2e964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:50.316839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e4b7f-26a3-4c7e-b04c-888463a2e964 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:50.326670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:50.330728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1165/2361] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:50.336068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348404a-fc96-4324-8fc4-689672172735 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:50.346675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348404a-fc96-4324-8fc4-689672172735 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:50.351545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862900e-e417-4fbf-96b1-d3cc7a8036d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:50.352213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862900e-e417-4fbf-96b1-d3cc7a8036d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.352684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862900e-e417-4fbf-96b1-d3cc7a8036d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.353144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862900e-e417-4fbf-96b1-d3cc7a8036d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.354316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862900e-e417-4fbf-96b1-d3cc7a8036d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:50.358581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862900e-e417-4fbf-96b1-d3cc7a8036d1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:50.410539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1197/2362] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:50 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:50.414423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e4b7f-26a3-4c7e-b04c-888463a2e964 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:50.425188 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e4b7f-26a3-4c7e-b04c-888463a2e964 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:50.500501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed49c1-f76c-454a-a420-029d956c5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:50.501521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed49c1-f76c-454a-a420-029d956c5d2c admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.502153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed49c1-f76c-454a-a420-029d956c5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.502879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed49c1-f76c-454a-a420-029d956c5d2c admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.503994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed49c1-f76c-454a-a420-029d956c5d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:50.507971 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed49c1-f76c-454a-a420-029d956c5d2c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:50.535076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1166/2363] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:50 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:46:50.539983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862900e-e417-4fbf-96b1-d3cc7a8036d1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:50.553588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862900e-e417-4fbf-96b1-d3cc7a8036d1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:50.564975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b53a92-4b49-4c34-87cd-1f0b0599158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:50.566058 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b53a92-4b49-4c34-87cd-1f0b0599158c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.566566 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b53a92-4b49-4c34-87cd-1f0b0599158c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.567128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b53a92-4b49-4c34-87cd-1f0b0599158c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.568377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b53a92-4b49-4c34-87cd-1f0b0599158c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:50.571671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b53a92-4b49-4c34-87cd-1f0b0599158c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:50.586578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1198/2364] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:50.592112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed49c1-f76c-454a-a420-029d956c5d2c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:50.603773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed49c1-f76c-454a-a420-029d956c5d2c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:50.611242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee599d7-b19f-4076-ba13-c67029b39f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:50.612155 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee599d7-b19f-4076-ba13-c67029b39f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.612650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee599d7-b19f-4076-ba13-c67029b39f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.613126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee599d7-b19f-4076-ba13-c67029b39f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.614365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee599d7-b19f-4076-ba13-c67029b39f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:50.617384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee599d7-b19f-4076-ba13-c67029b39f00 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:50.633574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1167/2365] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:50.639794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b53a92-4b49-4c34-87cd-1f0b0599158c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:50.651331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b53a92-4b49-4c34-87cd-1f0b0599158c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:50.656805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daf978-74a3-4cfd-af97-aaaad0d93a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:50.657481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daf978-74a3-4cfd-af97-aaaad0d93a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.657759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daf978-74a3-4cfd-af97-aaaad0d93a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.658040 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daf978-74a3-4cfd-af97-aaaad0d93a26 admin admin] PATH_INFO: `/v3/projects/da8600c7c735443d8e074a317b21f1d2/users/4483940b778941e6a3efa651ad0e6e7c/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.681098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daf978-74a3-4cfd-af97-aaaad0d93a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8600c7c735443d8e074a317b21f1d2, user_id=4483940b778941e6a3efa651ad0e6e7c, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:50.684240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daf978-74a3-4cfd-af97-aaaad0d93a26 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:50.701412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1199/2366] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:50 2022] PUT /identity/v3/projects/da8600c7c735443d8e074a317b21f1d2/users/4483940b778941e6a3efa651ad0e6e7c/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:50.712584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b82af3-2d67-4020-b48e-ac0c7fd183e0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.712940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b82af3-2d67-4020-b48e-ac0c7fd183e0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.713349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b82af3-2d67-4020-b48e-ac0c7fd183e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.752340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c1b82af3-2d67-4020-b48e-ac0c7fd183e0 None None] MFA Rules not processed for user `4483940b778941e6a3efa651ad0e6e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:50.753667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c1b82af3-2d67-4020-b48e-ac0c7fd183e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:50.829724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1168/2367] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:50.834303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daf978-74a3-4cfd-af97-aaaad0d93a26 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:50.896565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:50.920595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daf978-74a3-4cfd-af97-aaaad0d93a26 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:50.928400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddedfd4-a0e9-4bf1-a430-db0476e42425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:50.929053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddedfd4-a0e9-4bf1-a430-db0476e42425 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:50.929344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddedfd4-a0e9-4bf1-a430-db0476e42425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:50.930577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddedfd4-a0e9-4bf1-a430-db0476e42425 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:50.931704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddedfd4-a0e9-4bf1-a430-db0476e42425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:50.934654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddedfd4-a0e9-4bf1-a430-db0476e42425 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:50.969366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1200/2368] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:50 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:50.971498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b82af3-2d67-4020-b48e-ac0c7fd183e0 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:50.985407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b82af3-2d67-4020-b48e-ac0c7fd183e0 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:51.047513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b84a7-9dc0-469d-82bc-42acaf70d029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:51.048131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b84a7-9dc0-469d-82bc-42acaf70d029 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.048407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b84a7-9dc0-469d-82bc-42acaf70d029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.048677 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b84a7-9dc0-469d-82bc-42acaf70d029 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.049306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b84a7-9dc0-469d-82bc-42acaf70d029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:51.051221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b84a7-9dc0-469d-82bc-42acaf70d029 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:51.069304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:51.081790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddedfd4-a0e9-4bf1-a430-db0476e42425 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:51.082390 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1169/2369] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:50 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:51.095352 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddedfd4-a0e9-4bf1-a430-db0476e42425 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:51.100458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cdd39-5d75-4bfc-993e-f812b500fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:51.101148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cdd39-5d75-4bfc-993e-f812b500fca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.101506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cdd39-5d75-4bfc-993e-f812b500fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.101954 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cdd39-5d75-4bfc-993e-f812b500fca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.102801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cdd39-5d75-4bfc-993e-f812b500fca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:51.105425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cdd39-5d75-4bfc-993e-f812b500fca3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:51.118570 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1201/2370] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:51.123364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b84a7-9dc0-469d-82bc-42acaf70d029 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:51.135293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b84a7-9dc0-469d-82bc-42acaf70d029 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:51.142409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c72add-3a18-4afe-9b98-0f5176f84f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:51.143136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c72add-3a18-4afe-9b98-0f5176f84f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.143420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c72add-3a18-4afe-9b98-0f5176f84f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.143700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c72add-3a18-4afe-9b98-0f5176f84f02 admin admin] PATH_INFO: `/v3/projects/9057c42dca9d440cbf4e82093734e1e2/users/950f51c3720d44109ff939ec4512a261/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.163076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c72add-3a18-4afe-9b98-0f5176f84f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9057c42dca9d440cbf4e82093734e1e2, user_id=950f51c3720d44109ff939ec4512a261, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:51.165966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c72add-3a18-4afe-9b98-0f5176f84f02 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:51.185392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1170/2371] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:51 2022] PUT /identity/v3/projects/9057c42dca9d440cbf4e82093734e1e2/users/950f51c3720d44109ff939ec4512a261/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:51.186479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cdd39-5d75-4bfc-993e-f812b500fca3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:51.196844 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cdd39-5d75-4bfc-993e-f812b500fca3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:51.317300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1019f9a-a34e-4b88-83d7-21055338f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:51.318167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019f9a-a34e-4b88-83d7-21055338f3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.318429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019f9a-a34e-4b88-83d7-21055338f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.318769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1019f9a-a34e-4b88-83d7-21055338f3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.319829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019f9a-a34e-4b88-83d7-21055338f3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:51.321780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1019f9a-a34e-4b88-83d7-21055338f3b9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:51.340291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1202/2372] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:51.347317 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c72add-3a18-4afe-9b98-0f5176f84f02 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:51.350923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055a589-ac9d-4a72-9025-56cc34f5b099 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.351313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055a589-ac9d-4a72-9025-56cc34f5b099 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.351655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055a589-ac9d-4a72-9025-56cc34f5b099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.364796 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c72add-3a18-4afe-9b98-0f5176f84f02 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:51.374680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6055a589-ac9d-4a72-9025-56cc34f5b099 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:51.375036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39d3f-7b7f-4c90-9e2d-8a1fa3f2c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:51.375778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39d3f-7b7f-4c90-9e2d-8a1fa3f2c856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.376064 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39d3f-7b7f-4c90-9e2d-8a1fa3f2c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.376176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6055a589-ac9d-4a72-9025-56cc34f5b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:51.376338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39d3f-7b7f-4c90-9e2d-8a1fa3f2c856 admin admin] PATH_INFO: `/v3/projects/9057c42dca9d440cbf4e82093734e1e2/users/950f51c3720d44109ff939ec4512a261/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.378299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf39d3f-7b7f-4c90-9e2d-8a1fa3f2c856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9057c42dca9d440cbf4e82093734e1e2, user_id=950f51c3720d44109ff939ec4512a261, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:51.381920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf39d3f-7b7f-4c90-9e2d-8a1fa3f2c856 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:51.397420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1171/2373] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:51 2022] PUT /identity/v3/projects/9057c42dca9d440cbf4e82093734e1e2/users/950f51c3720d44109ff939ec4512a261/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:51.412439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fece6-ff65-4592-8651-e30579a15b1e None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.412819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fece6-ff65-4592-8651-e30579a15b1e None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.413264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fece6-ff65-4592-8651-e30579a15b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.448313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-a50fece6-ff65-4592-8651-e30579a15b1e None None] MFA Rules not processed for user `950f51c3720d44109ff939ec4512a261`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:51.451013 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a50fece6-ff65-4592-8651-e30579a15b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:51.461730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1203/2374] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:51.474023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055a589-ac9d-4a72-9025-56cc34f5b099 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:51.476437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6055a589-ac9d-4a72-9025-56cc34f5b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:51.564904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055a589-ac9d-4a72-9025-56cc34f5b099 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:51.574987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1172/2375] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:51.575657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:51.584605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fece6-ff65-4592-8651-e30579a15b1e None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:51.587497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a50fece6-ff65-4592-8651-e30579a15b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:51.654957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fece6-ff65-4592-8651-e30579a15b1e None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:51.658874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cdfb6-8f3a-4d73-bf08-25236061f434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:51.659531 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cdfb6-8f3a-4d73-bf08-25236061f434 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.659814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cdfb6-8f3a-4d73-bf08-25236061f434 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.660091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cdfb6-8f3a-4d73-bf08-25236061f434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.671858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cdfb6-8f3a-4d73-bf08-25236061f434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:51.673884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cdfb6-8f3a-4d73-bf08-25236061f434 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:51.677974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a5a72-59b9-4d8b-af33-709e9b593a9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:51.678784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a5a72-59b9-4d8b-af33-709e9b593a9a service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.679247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a5a72-59b9-4d8b-af33-709e9b593a9a service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.679719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a5a72-59b9-4d8b-af33-709e9b593a9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.685582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1173/2376] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:46:51.761110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a5a72-59b9-4d8b-af33-709e9b593a9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:51.764788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a5a72-59b9-4d8b-af33-709e9b593a9a service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:51.775728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1204/2377] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:46:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:46:51.781264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cdfb6-8f3a-4d73-bf08-25236061f434 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:51.791106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cdfb6-8f3a-4d73-bf08-25236061f434 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:51.795807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ede354-2bd9-4387-b412-55f301f9b33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:51.796569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede354-2bd9-4387-b412-55f301f9b33e service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:51.796932 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede354-2bd9-4387-b412-55f301f9b33e service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:51.797305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede354-2bd9-4387-b412-55f301f9b33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:51.868137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:51.896010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ede354-2bd9-4387-b412-55f301f9b33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:51.898483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ede354-2bd9-4387-b412-55f301f9b33e service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:51.918076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1174/2378] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:56.526107 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a5a72-59b9-4d8b-af33-709e9b593a9a service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.528317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ec4a5a72-59b9-4d8b-af33-709e9b593a9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:56.642026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a5a72-59b9-4d8b-af33-709e9b593a9a service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:56.648711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:56.649671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.650059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.650444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] PATH_INFO: `/v3/users/c1b5256e7ccb438c8ed3549cb4e1f185` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.652466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b5256e7ccb438c8ed3549cb4e1f185)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:56.655875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:56.738383 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b5256e7ccb438c8ed3549cb4e1f185'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.744338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:56.763699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b5256e7ccb438c8ed3549cb4e1f185'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.764741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b5256e7ccb438c8ed3549cb4e1f185'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.773980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b5256e7ccb438c8ed3549cb4e1f185'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.774756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b5256e7ccb438c8ed3549cb4e1f185'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:56.795062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1205/2379] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:56 2022] DELETE /identity/v3/users/c1b5256e7ccb438c8ed3549cb4e1f185 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:56.804670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26092e8-2627-420e-8aac-ec381beda019 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:56.805367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26092e8-2627-420e-8aac-ec381beda019 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:56.807569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26092e8-2627-420e-8aac-ec381beda019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:56.840115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-d26092e8-2627-420e-8aac-ec381beda019 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:56.844199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d26092e8-2627-420e-8aac-ec381beda019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:56.931550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1175/2380] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:56.943249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:56.943840 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.040684 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe9ba-dea0-488a-90c7-f33059097e41 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.045627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f4ee2-c101-4b67-ac18-2feafaafe8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.046894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f4ee2-c101-4b67-ac18-2feafaafe8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.047198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f4ee2-c101-4b67-ac18-2feafaafe8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.047541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f4ee2-c101-4b67-ac18-2feafaafe8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.059644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f4ee2-c101-4b67-ac18-2feafaafe8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.061437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f4ee2-c101-4b67-ac18-2feafaafe8b9 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.073137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1206/2381] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:57.419532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26092e8-2627-420e-8aac-ec381beda019 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.421275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d26092e8-2627-420e-8aac-ec381beda019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.441052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26092e8-2627-420e-8aac-ec381beda019 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.453121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.454084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.454536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.455022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] PATH_INFO: `/v3/projects/065d3513f5a743ea9c62fad84c517114` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.456451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=065d3513f5a743ea9c62fad84c517114)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.458634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.559132 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065d3513f5a743ea9c62fad84c517114', 'request_id': 'req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.570600 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065d3513f5a743ea9c62fad84c517114', 'request_id': 'req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.580853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065d3513f5a743ea9c62fad84c517114', 'request_id': 'req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.611140 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] The token cache is being invalidate because project 065d3513f5a743ea9c62fad84c517114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:46:57.611649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.616850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9fda1b3b-7df0-4fdb-8b76-d0edba323e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:57.618869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1176/2382] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:46:57 2022] DELETE /identity/v3/projects/065d3513f5a743ea9c62fad84c517114 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:57.624391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13353d5d-678f-42e7-851c-ba88917824c1 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.624867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13353d5d-678f-42e7-851c-ba88917824c1 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.625481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13353d5d-678f-42e7-851c-ba88917824c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.663211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-13353d5d-678f-42e7-851c-ba88917824c1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:57.664448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-13353d5d-678f-42e7-851c-ba88917824c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.740709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1207/2383] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:57.748400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1816a0a-9b13-46b0-9574-ab870120e96f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.748789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1816a0a-9b13-46b0-9574-ab870120e96f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.749165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1816a0a-9b13-46b0-9574-ab870120e96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.771336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-e1816a0a-9b13-46b0-9574-ab870120e96f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:57.772798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e1816a0a-9b13-46b0-9574-ab870120e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:57.782759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1177/2384] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:46:57.790568 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13353d5d-678f-42e7-851c-ba88917824c1 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.805126 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13353d5d-678f-42e7-851c-ba88917824c1 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.810142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09840-2bcb-4a7c-b625-4f000cb185bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.810836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09840-2bcb-4a7c-b625-4f000cb185bc admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.811212 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09840-2bcb-4a7c-b625-4f000cb185bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.811559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab09840-2bcb-4a7c-b625-4f000cb185bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.812295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab09840-2bcb-4a7c-b625-4f000cb185bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:46:57.812681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab09840-2bcb-4a7c-b625-4f000cb185bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.814420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab09840-2bcb-4a7c-b625-4f000cb185bc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.828687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1208/2385] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:46:57.834322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1816a0a-9b13-46b0-9574-ab870120e96f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.845201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1816a0a-9b13-46b0-9574-ab870120e96f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.850895 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2a88-b704-4d23-81d9-3541420e8655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.851593 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2a88-b704-4d23-81d9-3541420e8655 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.851880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2a88-b704-4d23-81d9-3541420e8655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.852214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2a88-b704-4d23-81d9-3541420e8655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.852805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2a88-b704-4d23-81d9-3541420e8655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.854967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2a88-b704-4d23-81d9-3541420e8655 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.888614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1178/2386] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:46:57 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:57.890536 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09840-2bcb-4a7c-b625-4f000cb185bc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:57.903305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab09840-2bcb-4a7c-b625-4f000cb185bc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:57.971666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99fca1-5d60-42a9-9bf6-3344df27fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:57.972318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99fca1-5d60-42a9-9bf6-3344df27fd89 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:57.972662 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99fca1-5d60-42a9-9bf6-3344df27fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:57.972924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99fca1-5d60-42a9-9bf6-3344df27fd89 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:57.973574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99fca1-5d60-42a9-9bf6-3344df27fd89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:57.975685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99fca1-5d60-42a9-9bf6-3344df27fd89 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:57.985486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:58.010613 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1209/2387] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:46:57 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:46:58.011870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2a88-b704-4d23-81d9-3541420e8655 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:58.024575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2a88-b704-4d23-81d9-3541420e8655 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:58.036017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b127-485b-4423-ae7e-c439e0c216cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:58.036760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b127-485b-4423-ae7e-c439e0c216cd admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:58.037057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b127-485b-4423-ae7e-c439e0c216cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:58.038095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b127-485b-4423-ae7e-c439e0c216cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:58.038827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5b127-485b-4423-ae7e-c439e0c216cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:58.048949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5b127-485b-4423-ae7e-c439e0c216cd admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:58.067967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1179/2388] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:46:58.069386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99fca1-5d60-42a9-9bf6-3344df27fd89 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:58.081635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99fca1-5d60-42a9-9bf6-3344df27fd89 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:58.096642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e5b63-14fb-40c5-ac0a-dcf9533f7e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:58.097770 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e5b63-14fb-40c5-ac0a-dcf9533f7e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:58.098598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e5b63-14fb-40c5-ac0a-dcf9533f7e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:58.099359 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e5b63-14fb-40c5-ac0a-dcf9533f7e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:58.100564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e5b63-14fb-40c5-ac0a-dcf9533f7e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:58.102822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e5b63-14fb-40c5-ac0a-dcf9533f7e3c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:58.122830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1210/2389] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:46:58.128249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b127-485b-4423-ae7e-c439e0c216cd admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:58.139496 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b127-485b-4423-ae7e-c439e0c216cd admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:58.144594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0e53f-8330-4cae-b3e5-a596fe7bc0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:58.145351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0e53f-8330-4cae-b3e5-a596fe7bc0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:58.145709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0e53f-8330-4cae-b3e5-a596fe7bc0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:58.146058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0e53f-8330-4cae-b3e5-a596fe7bc0ce admin admin] PATH_INFO: `/v3/projects/9badb76adcb345b0ac87438d0e5e8b3d/users/b23ca0849386420982a43a80af7a22f8/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:58.167000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0e53f-8330-4cae-b3e5-a596fe7bc0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9badb76adcb345b0ac87438d0e5e8b3d, user_id=b23ca0849386420982a43a80af7a22f8, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:58.170639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0e53f-8330-4cae-b3e5-a596fe7bc0ce admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:58.198877 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1180/2390] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:46:58 2022] PUT /identity/v3/projects/9badb76adcb345b0ac87438d0e5e8b3d/users/b23ca0849386420982a43a80af7a22f8/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:58.221888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01792430-7c2c-4cf9-8f38-f59b68ab3042 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:58.222257 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01792430-7c2c-4cf9-8f38-f59b68ab3042 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:58.222702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01792430-7c2c-4cf9-8f38-f59b68ab3042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:58.276249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-01792430-7c2c-4cf9-8f38-f59b68ab3042 None None] MFA Rules not processed for user `b23ca0849386420982a43a80af7a22f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:58.278530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-01792430-7c2c-4cf9-8f38-f59b68ab3042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:58.392934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1211/2391] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:46:58.401778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0e53f-8330-4cae-b3e5-a596fe7bc0ce admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:58.404077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a1e0e53f-8330-4cae-b3e5-a596fe7bc0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:58.414909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:58.504069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0e53f-8330-4cae-b3e5-a596fe7bc0ce admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:58.508411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb90582-6b13-472f-aff8-c4f461a0bee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:58.509145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb90582-6b13-472f-aff8-c4f461a0bee3 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:58.509512 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb90582-6b13-472f-aff8-c4f461a0bee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:58.509860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb90582-6b13-472f-aff8-c4f461a0bee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:58.521294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb90582-6b13-472f-aff8-c4f461a0bee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:58.523363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb90582-6b13-472f-aff8-c4f461a0bee3 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:58.535325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1181/2392] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:46:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:46:59.706007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01792430-7c2c-4cf9-8f38-f59b68ab3042 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:46:59.707667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-01792430-7c2c-4cf9-8f38-f59b68ab3042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:46:59.824646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01792430-7c2c-4cf9-8f38-f59b68ab3042 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:46:59.836689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:46:59.837550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:59.837918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:59.838259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] PATH_INFO: `/v3/users/4483940b778941e6a3efa651ad0e6e7c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:59.840010 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4483940b778941e6a3efa651ad0e6e7c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:46:59.842296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:46:59.916616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4483940b778941e6a3efa651ad0e6e7c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.931404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4483940b778941e6a3efa651ad0e6e7c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.932370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4483940b778941e6a3efa651ad0e6e7c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.937362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:46:59.942120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4483940b778941e6a3efa651ad0e6e7c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.942864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4483940b778941e6a3efa651ad0e6e7c'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:46:59.963528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1212/2393] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:46:59 2022] DELETE /identity/v3/users/4483940b778941e6a3efa651ad0e6e7c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:46:59.968320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a65e8-bda3-45ce-96ae-ed70f9fd6e28 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:46:59.969050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a65e8-bda3-45ce-96ae-ed70f9fd6e28 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:46:59.969050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a65e8-bda3-45ce-96ae-ed70f9fd6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:46:59.989882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b28a65e8-bda3-45ce-96ae-ed70f9fd6e28 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:46:59.991280 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b28a65e8-bda3-45ce-96ae-ed70f9fd6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:00.078041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1182/2394] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:00.088412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.093548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:00.160855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f8000-85cf-43f9-8a3b-d615b5456e24 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.165067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3163561-7e16-4b60-acff-e4be3309fa73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.165750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3163561-7e16-4b60-acff-e4be3309fa73 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.166028 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3163561-7e16-4b60-acff-e4be3309fa73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.166302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3163561-7e16-4b60-acff-e4be3309fa73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.177616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3163561-7e16-4b60-acff-e4be3309fa73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.179195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3163561-7e16-4b60-acff-e4be3309fa73 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.193323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1213/2395] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:00.635397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a65e8-bda3-45ce-96ae-ed70f9fd6e28 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.637714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b28a65e8-bda3-45ce-96ae-ed70f9fd6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:00.670660 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a65e8-bda3-45ce-96ae-ed70f9fd6e28 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.675961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.676762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.677079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.677464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] PATH_INFO: `/v3/projects/da8600c7c735443d8e074a317b21f1d2` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.679162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8600c7c735443d8e074a317b21f1d2)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.681407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.737895 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8600c7c735443d8e074a317b21f1d2', 'request_id': 'req-e2c93f01-0089-4def-9130-164449960942'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.744645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8600c7c735443d8e074a317b21f1d2', 'request_id': 'req-e2c93f01-0089-4def-9130-164449960942'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.750777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8600c7c735443d8e074a317b21f1d2', 'request_id': 'req-e2c93f01-0089-4def-9130-164449960942'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.761713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] The token cache is being invalidate because project da8600c7c735443d8e074a317b21f1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:00.762002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.762645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.764138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1183/2396] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:00 2022] DELETE /identity/v3/projects/da8600c7c735443d8e074a317b21f1d2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:00.768258 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3163561-7e16-4b60-acff-e4be3309fa73 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:00.777917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3163561-7e16-4b60-acff-e4be3309fa73 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:00.841402 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:00.842120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:00.842462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:00.842780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] PATH_INFO: `/v3/users/950f51c3720d44109ff939ec4512a261` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:00.844154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=950f51c3720d44109ff939ec4512a261)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:00.846415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:00.898167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950f51c3720d44109ff939ec4512a261'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.910738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950f51c3720d44109ff939ec4512a261'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.911503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950f51c3720d44109ff939ec4512a261'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.919569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950f51c3720d44109ff939ec4512a261'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.920357 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c6f7c443-5f8b-4029-8e49-4260603bf83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950f51c3720d44109ff939ec4512a261'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:00.932901 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1214/2397] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:00 2022] DELETE /identity/v3/users/950f51c3720d44109ff939ec4512a261 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:01.226881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.228730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:01.244931 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c93f01-0089-4def-9130-164449960942 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.280168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:01.312754 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.313303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.313585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.313853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] PATH_INFO: `/v3/projects/9057c42dca9d440cbf4e82093734e1e2` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.315017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9057c42dca9d440cbf4e82093734e1e2)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.316922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.365538 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9057c42dca9d440cbf4e82093734e1e2', 'request_id': 'req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:01.374456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9057c42dca9d440cbf4e82093734e1e2', 'request_id': 'req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:01.382043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9057c42dca9d440cbf4e82093734e1e2', 'request_id': 'req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:01.393768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] The token cache is being invalidate because project 9057c42dca9d440cbf4e82093734e1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:01.394057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:01.394728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c35d2f1d-410f-4e27-82c1-ddd9048ebc3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:01.396265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1184/2398] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:01 2022] DELETE /identity/v3/projects/9057c42dca9d440cbf4e82093734e1e2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:01.402804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50621b-5b0e-4fc4-94f8-f50b60b20b65 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.403400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50621b-5b0e-4fc4-94f8-f50b60b20b65 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.403686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50621b-5b0e-4fc4-94f8-f50b60b20b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.424933 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3f50621b-5b0e-4fc4-94f8-f50b60b20b65 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:01.426145 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3f50621b-5b0e-4fc4-94f8-f50b60b20b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:01.430734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:01.492360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1215/2399] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:01.500490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7b844-1d37-4756-a6f8-27781714e9a4 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.500781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7b844-1d37-4756-a6f8-27781714e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.501062 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7b844-1d37-4756-a6f8-27781714e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.520994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b8f7b844-1d37-4756-a6f8-27781714e9a4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:01.522204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b8f7b844-1d37-4756-a6f8-27781714e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:01.531150 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1185/2400] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:01.535445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50621b-5b0e-4fc4-94f8-f50b60b20b65 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.549567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50621b-5b0e-4fc4-94f8-f50b60b20b65 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.554466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4291a-b5e7-4811-bf3e-4c1696734759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.554970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4291a-b5e7-4811-bf3e-4c1696734759 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.555253 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4291a-b5e7-4811-bf3e-4c1696734759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.555530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4291a-b5e7-4811-bf3e-4c1696734759 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.556217 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4291a-b5e7-4811-bf3e-4c1696734759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:01.556520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4291a-b5e7-4811-bf3e-4c1696734759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.558141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4291a-b5e7-4811-bf3e-4c1696734759 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.570399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1216/2401] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:01.575298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7b844-1d37-4756-a6f8-27781714e9a4 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.584765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7b844-1d37-4756-a6f8-27781714e9a4 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.591503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05d094-0109-4caf-9f7e-fc6be2e808db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.592125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05d094-0109-4caf-9f7e-fc6be2e808db admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.592438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05d094-0109-4caf-9f7e-fc6be2e808db admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.592737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05d094-0109-4caf-9f7e-fc6be2e808db admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.593338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05d094-0109-4caf-9f7e-fc6be2e808db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.595234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05d094-0109-4caf-9f7e-fc6be2e808db admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.651484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1186/2402] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:01 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:01.654578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4291a-b5e7-4811-bf3e-4c1696734759 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.666439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4291a-b5e7-4811-bf3e-4c1696734759 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.742967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f74c70-6099-45bc-9dcc-ac01839cdc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.743594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74c70-6099-45bc-9dcc-ac01839cdc45 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.743878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74c70-6099-45bc-9dcc-ac01839cdc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.744159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f74c70-6099-45bc-9dcc-ac01839cdc45 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.744804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f74c70-6099-45bc-9dcc-ac01839cdc45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.746773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f74c70-6099-45bc-9dcc-ac01839cdc45 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.770635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1217/2403] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:01 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:01.775608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05d094-0109-4caf-9f7e-fc6be2e808db admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.793837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05d094-0109-4caf-9f7e-fc6be2e808db admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.800940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5334569-37ae-465a-aa52-bbc8d4f0adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.801628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5334569-37ae-465a-aa52-bbc8d4f0adf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.801938 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5334569-37ae-465a-aa52-bbc8d4f0adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.802307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5334569-37ae-465a-aa52-bbc8d4f0adf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.803095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5334569-37ae-465a-aa52-bbc8d4f0adf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.804970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5334569-37ae-465a-aa52-bbc8d4f0adf3 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.816757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1187/2404] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:01.821266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f74c70-6099-45bc-9dcc-ac01839cdc45 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.833169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f74c70-6099-45bc-9dcc-ac01839cdc45 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.838301 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426d792-76af-47d3-8817-16328e55fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.838912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426d792-76af-47d3-8817-16328e55fc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.839262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426d792-76af-47d3-8817-16328e55fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.840144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426d792-76af-47d3-8817-16328e55fc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.840874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426d792-76af-47d3-8817-16328e55fc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.842589 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426d792-76af-47d3-8817-16328e55fc93 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.854596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1218/2405] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:01.859668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5334569-37ae-465a-aa52-bbc8d4f0adf3 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:01.872252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5334569-37ae-465a-aa52-bbc8d4f0adf3 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:01.877084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd481d76-6322-4e44-a013-6215d0e8c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:01.878286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481d76-6322-4e44-a013-6215d0e8c380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.878286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481d76-6322-4e44-a013-6215d0e8c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.878286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481d76-6322-4e44-a013-6215d0e8c380 admin admin] PATH_INFO: `/v3/projects/350f021f514147d48b08d7ca709a5ca9/users/65ee1717215c4ebdb763cee273714718/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.903742 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481d76-6322-4e44-a013-6215d0e8c380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350f021f514147d48b08d7ca709a5ca9, user_id=65ee1717215c4ebdb763cee273714718, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:01.906700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481d76-6322-4e44-a013-6215d0e8c380 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:01.920531 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1188/2406] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:01 2022] PUT /identity/v3/projects/350f021f514147d48b08d7ca709a5ca9/users/65ee1717215c4ebdb763cee273714718/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:01.933008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc6ff1-8b4a-4ded-9eb4-2053e8bd93e3 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:01.933829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc6ff1-8b4a-4ded-9eb4-2053e8bd93e3 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:01.934405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc6ff1-8b4a-4ded-9eb4-2053e8bd93e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:01.963559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-31fc6ff1-8b4a-4ded-9eb4-2053e8bd93e3 None None] MFA Rules not processed for user `65ee1717215c4ebdb763cee273714718`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:01.964828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-31fc6ff1-8b4a-4ded-9eb4-2053e8bd93e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:02.067456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1219/2407] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:02.072347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd481d76-6322-4e44-a013-6215d0e8c380 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:02.150152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd481d76-6322-4e44-a013-6215d0e8c380 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:02.156889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b811f4-7b28-4db1-80c3-0d3e475a47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:02.157509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b811f4-7b28-4db1-80c3-0d3e475a47a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:02.157792 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b811f4-7b28-4db1-80c3-0d3e475a47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:02.158071 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b811f4-7b28-4db1-80c3-0d3e475a47a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:02.158715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b811f4-7b28-4db1-80c3-0d3e475a47a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:02.160714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b811f4-7b28-4db1-80c3-0d3e475a47a4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:02.165595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:02.196881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1189/2408] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:02 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:02.202097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc6ff1-8b4a-4ded-9eb4-2053e8bd93e3 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:02.209646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:02.217676 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc6ff1-8b4a-4ded-9eb4-2053e8bd93e3 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:02.308674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf39bf7-7f6a-45de-99ad-ddf289dbfc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:02.309615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf39bf7-7f6a-45de-99ad-ddf289dbfc85 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:02.310066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf39bf7-7f6a-45de-99ad-ddf289dbfc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:02.310511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf39bf7-7f6a-45de-99ad-ddf289dbfc85 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:02.311596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf39bf7-7f6a-45de-99ad-ddf289dbfc85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:02.314923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf39bf7-7f6a-45de-99ad-ddf289dbfc85 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:02.345770 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1220/2409] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:02 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:02.350635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b811f4-7b28-4db1-80c3-0d3e475a47a4 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:02.372590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b811f4-7b28-4db1-80c3-0d3e475a47a4 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:02.380353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9f52c-0b94-48aa-b63a-ae0d1ae5dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:02.381413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f52c-0b94-48aa-b63a-ae0d1ae5dbdf admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:02.381924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f52c-0b94-48aa-b63a-ae0d1ae5dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:02.382432 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f52c-0b94-48aa-b63a-ae0d1ae5dbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:02.383492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9f52c-0b94-48aa-b63a-ae0d1ae5dbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:02.386647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9f52c-0b94-48aa-b63a-ae0d1ae5dbdf admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:02.405947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1190/2410] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:02.410421 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf39bf7-7f6a-45de-99ad-ddf289dbfc85 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:02.424423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf39bf7-7f6a-45de-99ad-ddf289dbfc85 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:02.432368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3829c8-dbf6-400f-a826-3750aa0657a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:02.434188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3829c8-dbf6-400f-a826-3750aa0657a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:02.434711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3829c8-dbf6-400f-a826-3750aa0657a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:02.435262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3829c8-dbf6-400f-a826-3750aa0657a8 admin admin] PATH_INFO: `/v3/projects/879acfb6eb3c4c32a8ca227579ba8c03/users/a76c0d4ad50443f2bb98e18aa971d969/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:02.462250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3829c8-dbf6-400f-a826-3750aa0657a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879acfb6eb3c4c32a8ca227579ba8c03, user_id=a76c0d4ad50443f2bb98e18aa971d969, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:02.468004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3829c8-dbf6-400f-a826-3750aa0657a8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:02.490723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1221/2411] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:02 2022] PUT /identity/v3/projects/879acfb6eb3c4c32a8ca227579ba8c03/users/a76c0d4ad50443f2bb98e18aa971d969/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:02.496699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9f52c-0b94-48aa-b63a-ae0d1ae5dbdf admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:02.514890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9f52c-0b94-48aa-b63a-ae0d1ae5dbdf admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:02.584141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85387f7-dfa9-4a72-b9d8-11a78bf69f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:02.584916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85387f7-dfa9-4a72-b9d8-11a78bf69f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:02.585310 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85387f7-dfa9-4a72-b9d8-11a78bf69f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:02.585702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85387f7-dfa9-4a72-b9d8-11a78bf69f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:02.586460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85387f7-dfa9-4a72-b9d8-11a78bf69f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:02.588211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85387f7-dfa9-4a72-b9d8-11a78bf69f53 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:02.598827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1191/2412] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:02.603286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3829c8-dbf6-400f-a826-3750aa0657a8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:02.614137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3829c8-dbf6-400f-a826-3750aa0657a8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:02.619109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a214-233c-4289-8aba-26c9d19ae030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:02.619768 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a214-233c-4289-8aba-26c9d19ae030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:02.620072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a214-233c-4289-8aba-26c9d19ae030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:02.620384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a214-233c-4289-8aba-26c9d19ae030 admin admin] PATH_INFO: `/v3/projects/879acfb6eb3c4c32a8ca227579ba8c03/users/a76c0d4ad50443f2bb98e18aa971d969/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:02.622207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a214-233c-4289-8aba-26c9d19ae030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879acfb6eb3c4c32a8ca227579ba8c03, user_id=a76c0d4ad50443f2bb98e18aa971d969, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:02.624847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a214-233c-4289-8aba-26c9d19ae030 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:02.640117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1222/2413] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:02 2022] PUT /identity/v3/projects/879acfb6eb3c4c32a8ca227579ba8c03/users/a76c0d4ad50443f2bb98e18aa971d969/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:02.655318 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0710e-bc04-43a1-a6ea-d5f33d45e9a4 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:02.655609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0710e-bc04-43a1-a6ea-d5f33d45e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:02.655915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0710e-bc04-43a1-a6ea-d5f33d45e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:02.684688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-eee0710e-bc04-43a1-a6ea-d5f33d45e9a4 None None] MFA Rules not processed for user `a76c0d4ad50443f2bb98e18aa971d969`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:02.685894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-eee0710e-bc04-43a1-a6ea-d5f33d45e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:02.763943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1192/2414] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:02.777329 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a214-233c-4289-8aba-26c9d19ae030 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:02.780917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9602a214-233c-4289-8aba-26c9d19ae030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:02.873491 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a214-233c-4289-8aba-26c9d19ae030 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:02.879976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4b027-1c8c-4c4f-9631-ccb54dc1937c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:02.881019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4b027-1c8c-4c4f-9631-ccb54dc1937c service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:02.881526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4b027-1c8c-4c4f-9631-ccb54dc1937c service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:02.881991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4b027-1c8c-4c4f-9631-ccb54dc1937c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:02.899556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4b027-1c8c-4c4f-9631-ccb54dc1937c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:02.902851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4b027-1c8c-4c4f-9631-ccb54dc1937c service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:02.918799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1223/2415] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:03.002816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0710e-bc04-43a1-a6ea-d5f33d45e9a4 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:03.073808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:03.082015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0710e-bc04-43a1-a6ea-d5f33d45e9a4 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:03.087211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:03.087892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:03.088176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:03.088453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] PATH_INFO: `/v3/users/65ee1717215c4ebdb763cee273714718` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:03.089668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ee1717215c4ebdb763cee273714718)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:03.091849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:03.160501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ee1717215c4ebdb763cee273714718'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.161152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ee1717215c4ebdb763cee273714718'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.176874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ee1717215c4ebdb763cee273714718'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.185219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ee1717215c4ebdb763cee273714718'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.185895 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ee1717215c4ebdb763cee273714718'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.199088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1193/2416] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:03 2022] DELETE /identity/v3/users/65ee1717215c4ebdb763cee273714718 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:03.204393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e97d7-abeb-42ce-a1f9-18752e504f5c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:03.204685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e97d7-abeb-42ce-a1f9-18752e504f5c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:03.204965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e97d7-abeb-42ce-a1f9-18752e504f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:03.225335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-703e97d7-abeb-42ce-a1f9-18752e504f5c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:03.226551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-703e97d7-abeb-42ce-a1f9-18752e504f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:03.279884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:03.289274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1224/2417] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:03.299699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:03.301216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:03.359922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fe74f-05d4-40ce-86c9-f0af11432636 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:03.363681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24c67-5e5d-4331-9745-ef64641b7d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:03.364288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24c67-5e5d-4331-9745-ef64641b7d6f service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:03.364567 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24c67-5e5d-4331-9745-ef64641b7d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:03.364835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24c67-5e5d-4331-9745-ef64641b7d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:03.378967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec24c67-5e5d-4331-9745-ef64641b7d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:03.380422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec24c67-5e5d-4331-9745-ef64641b7d6f service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:03.390793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1194/2418] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:03.675116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e97d7-abeb-42ce-a1f9-18752e504f5c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:03.676697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-703e97d7-abeb-42ce-a1f9-18752e504f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:03.689165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e97d7-abeb-42ce-a1f9-18752e504f5c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:03.693936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:03.694590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:03.694865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:03.695255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] PATH_INFO: `/v3/projects/350f021f514147d48b08d7ca709a5ca9` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:03.696521 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350f021f514147d48b08d7ca709a5ca9)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:03.699434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:03.749002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350f021f514147d48b08d7ca709a5ca9', 'request_id': 'req-fd75f513-45f9-47f0-810b-8c714a3691f7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.755611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350f021f514147d48b08d7ca709a5ca9', 'request_id': 'req-fd75f513-45f9-47f0-810b-8c714a3691f7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.766156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350f021f514147d48b08d7ca709a5ca9', 'request_id': 'req-fd75f513-45f9-47f0-810b-8c714a3691f7'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.781979 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] The token cache is being invalidate because project 350f021f514147d48b08d7ca709a5ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:03.783059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.783719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.785628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1225/2419] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:03 2022] DELETE /identity/v3/projects/350f021f514147d48b08d7ca709a5ca9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:03.790031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24c67-5e5d-4331-9745-ef64641b7d6f service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:03.800819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24c67-5e5d-4331-9745-ef64641b7d6f service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:03.869194 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:03.869764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:03.870049 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:03.870647 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] PATH_INFO: `/v3/users/a76c0d4ad50443f2bb98e18aa971d969` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:03.871691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76c0d4ad50443f2bb98e18aa971d969)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:03.873740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:03.894559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:03.896056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:03.908080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:03.919938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75f513-45f9-47f0-810b-8c714a3691f7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:03.925914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:03.926697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:03.927076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:03.927447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] PATH_INFO: `/v3/users/b23ca0849386420982a43a80af7a22f8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:03.928777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23ca0849386420982a43a80af7a22f8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:03.931303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:03.942306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76c0d4ad50443f2bb98e18aa971d969'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.943242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76c0d4ad50443f2bb98e18aa971d969'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.980224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76c0d4ad50443f2bb98e18aa971d969'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.992605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76c0d4ad50443f2bb98e18aa971d969'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:03.993210 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-199be7a9-de97-46e7-8f2f-7b0febf5578b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76c0d4ad50443f2bb98e18aa971d969'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.004757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23ca0849386420982a43a80af7a22f8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.020328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1195/2420] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:03 2022] DELETE /identity/v3/users/a76c0d4ad50443f2bb98e18aa971d969 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:04.045415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23ca0849386420982a43a80af7a22f8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.046468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23ca0849386420982a43a80af7a22f8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.071634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23ca0849386420982a43a80af7a22f8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.072696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23ca0849386420982a43a80af7a22f8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.098261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1226/2421] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:03 2022] DELETE /identity/v3/users/b23ca0849386420982a43a80af7a22f8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:04.105113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c41a-8143-4b77-8ce7-593d689550ed None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.105831 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c41a-8143-4b77-8ce7-593d689550ed None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.106671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c41a-8143-4b77-8ce7-593d689550ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.134437 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-11c1c41a-8143-4b77-8ce7-593d689550ed None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:04.136283 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-11c1c41a-8143-4b77-8ce7-593d689550ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:04.218467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1196/2422] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:04.230174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:04.231601 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:04.309850 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3c4d1-814e-4d41-a81a-388fe2055791 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:04.312980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7675b-3fad-415a-ae62-3a50d458f0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:04.313596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7675b-3fad-415a-ae62-3a50d458f0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.313875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7675b-3fad-415a-ae62-3a50d458f0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.314149 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7675b-3fad-415a-ae62-3a50d458f0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.325754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7675b-3fad-415a-ae62-3a50d458f0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:04.327264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7675b-3fad-415a-ae62-3a50d458f0c0 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:04.331448 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:04.339871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1227/2423] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:04.525353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1c41a-8143-4b77-8ce7-593d689550ed None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:04.528495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-11c1c41a-8143-4b77-8ce7-593d689550ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:04.541454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1c41a-8143-4b77-8ce7-593d689550ed None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:04.546406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:04.547315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.547596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.547868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] PATH_INFO: `/v3/projects/879acfb6eb3c4c32a8ca227579ba8c03` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.549221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=879acfb6eb3c4c32a8ca227579ba8c03)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:04.551339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:04.624054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879acfb6eb3c4c32a8ca227579ba8c03', 'request_id': 'req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.640032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879acfb6eb3c4c32a8ca227579ba8c03', 'request_id': 'req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.647950 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879acfb6eb3c4c32a8ca227579ba8c03', 'request_id': 'req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.661701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] The token cache is being invalidate because project 879acfb6eb3c4c32a8ca227579ba8c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:04.662004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.662832 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:04.664910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1197/2424] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:04 2022] DELETE /identity/v3/projects/879acfb6eb3c4c32a8ca227579ba8c03 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:04.669815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73833ad7-9718-4009-909b-2fcdb2b063ab None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.670111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73833ad7-9718-4009-909b-2fcdb2b063ab None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.670374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73833ad7-9718-4009-909b-2fcdb2b063ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.691210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-73833ad7-9718-4009-909b-2fcdb2b063ab None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:04.692518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-73833ad7-9718-4009-909b-2fcdb2b063ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:04.728568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:04.730348 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:04.757627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:04.778715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1228/2425] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:04.787305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6295a1a-4de6-4996-86b1-541099359e6e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.787874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6295a1a-4de6-4996-86b1-541099359e6e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.788121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6295a1a-4de6-4996-86b1-541099359e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.818046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f6295a1a-4de6-4996-86b1-541099359e6e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:04.819417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f6295a1a-4de6-4996-86b1-541099359e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:04.831783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1229/2426] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:04.833060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f5edb-4821-4fd0-b8cb-7b271ee2fd8b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:04.834638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6295a1a-4de6-4996-86b1-541099359e6e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:04.841021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:04.841884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.841884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.842149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] PATH_INFO: `/v3/projects/9badb76adcb345b0ac87438d0e5e8b3d` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.843476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9badb76adcb345b0ac87438d0e5e8b3d)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:04.845631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6295a1a-4de6-4996-86b1-541099359e6e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:04.846136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:04.850634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ff44-39e5-4fe7-a3c2-023ba1fdcab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:04.851319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ff44-39e5-4fe7-a3c2-023ba1fdcab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.851616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ff44-39e5-4fe7-a3c2-023ba1fdcab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.851882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ff44-39e5-4fe7-a3c2-023ba1fdcab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.852540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057ff44-39e5-4fe7-a3c2-023ba1fdcab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:04.852838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057ff44-39e5-4fe7-a3c2-023ba1fdcab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:04.854438 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057ff44-39e5-4fe7-a3c2-023ba1fdcab5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:04.873207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1230/2427] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:04.874457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ff44-39e5-4fe7-a3c2-023ba1fdcab5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:04.895447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ff44-39e5-4fe7-a3c2-023ba1fdcab5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:04.904945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a334-4a53-44b3-b344-6713a35a190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:04.905591 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a334-4a53-44b3-b344-6713a35a190a admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:04.905866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a334-4a53-44b3-b344-6713a35a190a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:04.906385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a334-4a53-44b3-b344-6713a35a190a admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:04.911486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1a334-4a53-44b3-b344-6713a35a190a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:04.913674 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1a334-4a53-44b3-b344-6713a35a190a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.015657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9badb76adcb345b0ac87438d0e5e8b3d', 'request_id': 'req-01e436c5-1193-4446-86e7-e8ffdf6653a9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.020683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1231/2428] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:04 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:05.023857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9badb76adcb345b0ac87438d0e5e8b3d', 'request_id': 'req-01e436c5-1193-4446-86e7-e8ffdf6653a9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.025959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a334-4a53-44b3-b344-6713a35a190a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.030473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9badb76adcb345b0ac87438d0e5e8b3d', 'request_id': 'req-01e436c5-1193-4446-86e7-e8ffdf6653a9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.045212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] The token cache is being invalidate because project 9badb76adcb345b0ac87438d0e5e8b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:05.045975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.046667 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-01e436c5-1193-4446-86e7-e8ffdf6653a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:05.048633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1198/2429] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:04 2022] DELETE /identity/v3/projects/9badb76adcb345b0ac87438d0e5e8b3d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:05.055257 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504607a-aa5e-4ab6-bc19-aa78c790bcec None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.055557 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504607a-aa5e-4ab6-bc19-aa78c790bcec None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.056061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504607a-aa5e-4ab6-bc19-aa78c790bcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.076803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c504607a-aa5e-4ab6-bc19-aa78c790bcec None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:05.078074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c504607a-aa5e-4ab6-bc19-aa78c790bcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.091608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a334-4a53-44b3-b344-6713a35a190a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.096474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553504d-bc48-46bc-8a7a-c1420c013ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.097116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553504d-bc48-46bc-8a7a-c1420c013ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.097409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553504d-bc48-46bc-8a7a-c1420c013ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.097677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553504d-bc48-46bc-8a7a-c1420c013ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.098316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553504d-bc48-46bc-8a7a-c1420c013ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.100348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553504d-bc48-46bc-8a7a-c1420c013ac6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.124297 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1232/2430] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:05.128811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553504d-bc48-46bc-8a7a-c1420c013ac6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.131014 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2553504d-bc48-46bc-8a7a-c1420c013ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.141828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1199/2431] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:05.143728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553504d-bc48-46bc-8a7a-c1420c013ac6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.148985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd382c-6f3e-4967-9c96-1ff441acf290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.149765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4aa9-6798-47e4-a3bf-558630ebc8c8 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.149765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4aa9-6798-47e4-a3bf-558630ebc8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.149955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd382c-6f3e-4967-9c96-1ff441acf290 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.150045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4aa9-6798-47e4-a3bf-558630ebc8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.150133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd382c-6f3e-4967-9c96-1ff441acf290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.150133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd382c-6f3e-4967-9c96-1ff441acf290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.150782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd382c-6f3e-4967-9c96-1ff441acf290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.152584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd382c-6f3e-4967-9c96-1ff441acf290 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.165493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1233/2432] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:05.170605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd382c-6f3e-4967-9c96-1ff441acf290 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.172521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-739e4aa9-6798-47e4-a3bf-558630ebc8c8 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:05.174237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-739e4aa9-6798-47e4-a3bf-558630ebc8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.180671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd382c-6f3e-4967-9c96-1ff441acf290 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.187177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02170cd9-7eb9-4e66-8c92-25096c768f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.187666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02170cd9-7eb9-4e66-8c92-25096c768f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.187868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1200/2433] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:05.187989 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02170cd9-7eb9-4e66-8c92-25096c768f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.188187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02170cd9-7eb9-4e66-8c92-25096c768f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.188839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02170cd9-7eb9-4e66-8c92-25096c768f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.190775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02170cd9-7eb9-4e66-8c92-25096c768f68 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.191959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4aa9-6798-47e4-a3bf-558630ebc8c8 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.202239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4aa9-6798-47e4-a3bf-558630ebc8c8 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.203890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1234/2434] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:05.207842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02170cd9-7eb9-4e66-8c92-25096c768f68 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.211015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efa324-236c-4b48-8f0a-8ae8017e5754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.211653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efa324-236c-4b48-8f0a-8ae8017e5754 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.211936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efa324-236c-4b48-8f0a-8ae8017e5754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.212216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efa324-236c-4b48-8f0a-8ae8017e5754 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.212886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efa324-236c-4b48-8f0a-8ae8017e5754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:05.213190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efa324-236c-4b48-8f0a-8ae8017e5754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.214919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efa324-236c-4b48-8f0a-8ae8017e5754 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.219151 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02170cd9-7eb9-4e66-8c92-25096c768f68 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.225639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dce8f5-56e1-4706-81a7-91cde4dfced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.226319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dce8f5-56e1-4706-81a7-91cde4dfced0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.226606 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dce8f5-56e1-4706-81a7-91cde4dfced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.226888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dce8f5-56e1-4706-81a7-91cde4dfced0 admin admin] PATH_INFO: `/v3/projects/dbad85a92d7c4c17bddf0782be085fde/users/d6ffd414b96e4ac4ad4f582b4085bfa3/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.229076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1201/2435] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:05.234469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efa324-236c-4b48-8f0a-8ae8017e5754 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.248730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efa324-236c-4b48-8f0a-8ae8017e5754 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.250728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dce8f5-56e1-4706-81a7-91cde4dfced0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbad85a92d7c4c17bddf0782be085fde, user_id=d6ffd414b96e4ac4ad4f582b4085bfa3, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.253791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dce8f5-56e1-4706-81a7-91cde4dfced0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.254393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384dbcb-2a81-441e-b1b7-28f126db654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.255077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384dbcb-2a81-441e-b1b7-28f126db654e admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.255322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384dbcb-2a81-441e-b1b7-28f126db654e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.255582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384dbcb-2a81-441e-b1b7-28f126db654e admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.256364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384dbcb-2a81-441e-b1b7-28f126db654e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.258289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384dbcb-2a81-441e-b1b7-28f126db654e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.265537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:05.271704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1235/2436] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:05 2022] PUT /identity/v3/projects/dbad85a92d7c4c17bddf0782be085fde/users/d6ffd414b96e4ac4ad4f582b4085bfa3/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:05.283829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872e2de-e50b-4114-831e-66f5e12e0d04 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.284152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872e2de-e50b-4114-831e-66f5e12e0d04 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.284709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872e2de-e50b-4114-831e-66f5e12e0d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.290962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1202/2437] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:05.295561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384dbcb-2a81-441e-b1b7-28f126db654e admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.307802 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:05.319143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4872e2de-e50b-4114-831e-66f5e12e0d04 None None] MFA Rules not processed for user `d6ffd414b96e4ac4ad4f582b4085bfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:05.320266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4872e2de-e50b-4114-831e-66f5e12e0d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.380794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384dbcb-2a81-441e-b1b7-28f126db654e admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.386447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ea335-ae88-40c1-8d0a-72645ffc2675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.387105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea335-ae88-40c1-8d0a-72645ffc2675 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.387527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea335-ae88-40c1-8d0a-72645ffc2675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.387947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ea335-ae88-40c1-8d0a-72645ffc2675 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.388583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ea335-ae88-40c1-8d0a-72645ffc2675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.390748 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ea335-ae88-40c1-8d0a-72645ffc2675 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.394630 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1236/2438] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:05.399379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872e2de-e50b-4114-831e-66f5e12e0d04 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.415748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872e2de-e50b-4114-831e-66f5e12e0d04 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.420469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1203/2439] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:05.421640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ea335-ae88-40c1-8d0a-72645ffc2675 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.424758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6b0a5-ff2b-4c7c-b0f6-d3fd65296902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.425646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6b0a5-ff2b-4c7c-b0f6-d3fd65296902 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.426129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6b0a5-ff2b-4c7c-b0f6-d3fd65296902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.426603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6b0a5-ff2b-4c7c-b0f6-d3fd65296902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.427368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6b0a5-ff2b-4c7c-b0f6-d3fd65296902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.429364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6b0a5-ff2b-4c7c-b0f6-d3fd65296902 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.435456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ea335-ae88-40c1-8d0a-72645ffc2675 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.440784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba062fa-bf5f-4e24-b626-e097bb11d7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.441393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba062fa-bf5f-4e24-b626-e097bb11d7fc admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.441673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba062fa-bf5f-4e24-b626-e097bb11d7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.441944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba062fa-bf5f-4e24-b626-e097bb11d7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.442597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba062fa-bf5f-4e24-b626-e097bb11d7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.444261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba062fa-bf5f-4e24-b626-e097bb11d7fc admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.456030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1204/2440] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:05.460191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba062fa-bf5f-4e24-b626-e097bb11d7fc admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.465964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1237/2441] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:05.469787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6b0a5-ff2b-4c7c-b0f6-d3fd65296902 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.474398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba062fa-bf5f-4e24-b626-e097bb11d7fc admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.535382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424aba5-c492-40af-abc8-b58ecece0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.536102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424aba5-c492-40af-abc8-b58ecece0939 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.536384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424aba5-c492-40af-abc8-b58ecece0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.536747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424aba5-c492-40af-abc8-b58ecece0939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.537312 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424aba5-c492-40af-abc8-b58ecece0939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.538966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424aba5-c492-40af-abc8-b58ecece0939 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.549626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1205/2442] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:05.550520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6b0a5-ff2b-4c7c-b0f6-d3fd65296902 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.553725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424aba5-c492-40af-abc8-b58ecece0939 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.555538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec205-4111-4c20-bfb1-e60f3e2f880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.556153 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec205-4111-4c20-bfb1-e60f3e2f880f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.556429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec205-4111-4c20-bfb1-e60f3e2f880f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.556697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec205-4111-4c20-bfb1-e60f3e2f880f admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.557328 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec205-4111-4c20-bfb1-e60f3e2f880f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.560120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec205-4111-4c20-bfb1-e60f3e2f880f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.564285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424aba5-c492-40af-abc8-b58ecece0939 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.569250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f18fd9-efed-48c4-bb9f-ab3fc3034f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.569910 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18fd9-efed-48c4-bb9f-ab3fc3034f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.570193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18fd9-efed-48c4-bb9f-ab3fc3034f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.570477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18fd9-efed-48c4-bb9f-ab3fc3034f90 admin admin] PATH_INFO: `/v3/projects/4290053e1f7840adac942bb5ba4c9173/users/757dce1558354968862f47eae45129bc/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.584962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1238/2443] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:05.586067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec205-4111-4c20-bfb1-e60f3e2f880f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.587081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f18fd9-efed-48c4-bb9f-ab3fc3034f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4290053e1f7840adac942bb5ba4c9173, user_id=757dce1558354968862f47eae45129bc, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.590354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f18fd9-efed-48c4-bb9f-ab3fc3034f90 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.596826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec205-4111-4c20-bfb1-e60f3e2f880f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.603652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1206/2444] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:05 2022] PUT /identity/v3/projects/4290053e1f7840adac942bb5ba4c9173/users/757dce1558354968862f47eae45129bc/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:05.609318 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17323e90-7a43-4c6f-8cca-47d5c605039a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.609640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17323e90-7a43-4c6f-8cca-47d5c605039a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.609919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17323e90-7a43-4c6f-8cca-47d5c605039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.628787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-17323e90-7a43-4c6f-8cca-47d5c605039a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:05.630040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-17323e90-7a43-4c6f-8cca-47d5c605039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.655184 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:05.663751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7283702-e934-444c-8663-2b679ab1cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.664383 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7283702-e934-444c-8663-2b679ab1cecd admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.665070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7283702-e934-444c-8663-2b679ab1cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.665070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7283702-e934-444c-8663-2b679ab1cecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.665581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7283702-e934-444c-8663-2b679ab1cecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.667211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7283702-e934-444c-8663-2b679ab1cecd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.678092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1239/2445] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:05.682288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7283702-e934-444c-8663-2b679ab1cecd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.686862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:05.692477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7283702-e934-444c-8663-2b679ab1cecd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.696041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1207/2446] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:05.699314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c71fed-e5ff-4332-a8db-0c6d9cee007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.699314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c71fed-e5ff-4332-a8db-0c6d9cee007d admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.699314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c71fed-e5ff-4332-a8db-0c6d9cee007d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.699314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c71fed-e5ff-4332-a8db-0c6d9cee007d admin admin] PATH_INFO: `/v3/projects/3d1b3dd3f13d406090946c26f1f7cd86/users/61f93ff1c1f948a2aa236904119a48a9/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.705826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17323e90-7a43-4c6f-8cca-47d5c605039a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.707917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-17323e90-7a43-4c6f-8cca-47d5c605039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:05.714227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c71fed-e5ff-4332-a8db-0c6d9cee007d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1b3dd3f13d406090946c26f1f7cd86, user_id=61f93ff1c1f948a2aa236904119a48a9, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.717424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c71fed-e5ff-4332-a8db-0c6d9cee007d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.732177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1240/2447] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:05 2022] PUT /identity/v3/projects/3d1b3dd3f13d406090946c26f1f7cd86/users/61f93ff1c1f948a2aa236904119a48a9/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:05.736130 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c71fed-e5ff-4332-a8db-0c6d9cee007d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.766325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17323e90-7a43-4c6f-8cca-47d5c605039a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.819519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c71fed-e5ff-4332-a8db-0c6d9cee007d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.825244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af688a-8328-4cc4-b60c-43826c3d812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.825787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1261-e8aa-40ee-a9c8-5177737a3489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.825935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af688a-8328-4cc4-b60c-43826c3d812e admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.826141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af688a-8328-4cc4-b60c-43826c3d812e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.826411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af688a-8328-4cc4-b60c-43826c3d812e admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.826532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1261-e8aa-40ee-a9c8-5177737a3489 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.826707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1261-e8aa-40ee-a9c8-5177737a3489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.827021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1261-e8aa-40ee-a9c8-5177737a3489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.827240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af688a-8328-4cc4-b60c-43826c3d812e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.828778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af688a-8328-4cc4-b60c-43826c3d812e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.837255 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f1261-e8aa-40ee-a9c8-5177737a3489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.838700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f1261-e8aa-40ee-a9c8-5177737a3489 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.840614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1241/2448] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:05.844854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af688a-8328-4cc4-b60c-43826c3d812e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:05.850535 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1208/2449] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:05.855921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af688a-8328-4cc4-b60c-43826c3d812e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:05.860843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705dee7-d2a4-4dfa-8874-794f32a8ec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:05.861518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705dee7-d2a4-4dfa-8874-794f32a8ec07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.861802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705dee7-d2a4-4dfa-8874-794f32a8ec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.862081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705dee7-d2a4-4dfa-8874-794f32a8ec07 admin admin] PATH_INFO: `/v3/projects/3d1b3dd3f13d406090946c26f1f7cd86/users/61f93ff1c1f948a2aa236904119a48a9/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.864079 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705dee7-d2a4-4dfa-8874-794f32a8ec07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1b3dd3f13d406090946c26f1f7cd86, user_id=61f93ff1c1f948a2aa236904119a48a9, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:05.866748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705dee7-d2a4-4dfa-8874-794f32a8ec07 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:05.878980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1242/2450] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:05 2022] PUT /identity/v3/projects/3d1b3dd3f13d406090946c26f1f7cd86/users/61f93ff1c1f948a2aa236904119a48a9/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:05.889812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b081-a57d-452e-922c-eb51efb9dd1f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:05.890108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b081-a57d-452e-922c-eb51efb9dd1f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:05.890381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66b081-a57d-452e-922c-eb51efb9dd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:05.922993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-bf66b081-a57d-452e-922c-eb51efb9dd1f None None] MFA Rules not processed for user `61f93ff1c1f948a2aa236904119a48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:05.924591 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bf66b081-a57d-452e-922c-eb51efb9dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:06.016444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1209/2451] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:06.031773 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705dee7-d2a4-4dfa-8874-794f32a8ec07 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.033690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3705dee7-d2a4-4dfa-8874-794f32a8ec07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:06.108979 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705dee7-d2a4-4dfa-8874-794f32a8ec07 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.113233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd0e2-691c-434b-8e74-cafb8f9f7f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.113972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd0e2-691c-434b-8e74-cafb8f9f7f78 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.114240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd0e2-691c-434b-8e74-cafb8f9f7f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.114513 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd0e2-691c-434b-8e74-cafb8f9f7f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.124609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd0e2-691c-434b-8e74-cafb8f9f7f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.126085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd0e2-691c-434b-8e74-cafb8f9f7f78 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.137619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1243/2452] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:06.596522 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b081-a57d-452e-922c-eb51efb9dd1f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.679105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:06.706294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66b081-a57d-452e-922c-eb51efb9dd1f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:06.711816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:06.712711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.713026 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.713301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] PATH_INFO: `/v3/users/d6ffd414b96e4ac4ad4f582b4085bfa3` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.714760 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ffd414b96e4ac4ad4f582b4085bfa3)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:06.716759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:06.790229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ffd414b96e4ac4ad4f582b4085bfa3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:06.791219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ffd414b96e4ac4ad4f582b4085bfa3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:06.807491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ffd414b96e4ac4ad4f582b4085bfa3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:06.820995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ffd414b96e4ac4ad4f582b4085bfa3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:06.821731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ffd414b96e4ac4ad4f582b4085bfa3'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:06.837306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1210/2453] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:06 2022] DELETE /identity/v3/users/d6ffd414b96e4ac4ad4f582b4085bfa3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:06.841650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc6dd7-70e6-453b-8127-d0c0bf1c353f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:06.842167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc6dd7-70e6-453b-8127-d0c0bf1c353f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:06.842262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc6dd7-70e6-453b-8127-d0c0bf1c353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:06.865509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-29fc6dd7-70e6-453b-8127-d0c0bf1c353f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:06.866838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-29fc6dd7-70e6-453b-8127-d0c0bf1c353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:06.950759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:06.981711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1244/2454] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:06.993154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:06.995793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:07.125573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426f4a4-6a35-4cd2-80f1-97d3bba964f3 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:07.131385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5efd7-4a45-4c2a-af62-6f1d04a5a146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:07.132516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5efd7-4a45-4c2a-af62-6f1d04a5a146 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:07.133461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5efd7-4a45-4c2a-af62-6f1d04a5a146 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:07.133461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5efd7-4a45-4c2a-af62-6f1d04a5a146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:07.144994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5efd7-4a45-4c2a-af62-6f1d04a5a146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:07.146600 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5efd7-4a45-4c2a-af62-6f1d04a5a146 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:07.175621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1211/2455] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:07.479775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc6dd7-70e6-453b-8127-d0c0bf1c353f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:07.481890 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-29fc6dd7-70e6-453b-8127-d0c0bf1c353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:07.496976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc6dd7-70e6-453b-8127-d0c0bf1c353f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:07.504851 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:07.506212 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:07.506751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:07.507288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] PATH_INFO: `/v3/projects/dbad85a92d7c4c17bddf0782be085fde` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:07.508735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbad85a92d7c4c17bddf0782be085fde)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:07.511051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:07.581625 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbad85a92d7c4c17bddf0782be085fde', 'request_id': 'req-aecd116d-5837-4c53-b759-15fe1a1df7c9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.590099 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbad85a92d7c4c17bddf0782be085fde', 'request_id': 'req-aecd116d-5837-4c53-b759-15fe1a1df7c9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.603621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbad85a92d7c4c17bddf0782be085fde', 'request_id': 'req-aecd116d-5837-4c53-b759-15fe1a1df7c9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.623169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] The token cache is being invalidate because project dbad85a92d7c4c17bddf0782be085fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:07.623554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.624312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.626439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1245/2456] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:07 2022] DELETE /identity/v3/projects/dbad85a92d7c4c17bddf0782be085fde => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:07.631000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5efd7-4a45-4c2a-af62-6f1d04a5a146 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:07.649588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5efd7-4a45-4c2a-af62-6f1d04a5a146 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:07.724644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:07.725364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:07.725712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:07.725994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] PATH_INFO: `/v3/users/61f93ff1c1f948a2aa236904119a48a9` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:07.727422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f93ff1c1f948a2aa236904119a48a9)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:07.729322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:07.735847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:07.810199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f93ff1c1f948a2aa236904119a48a9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.811029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f93ff1c1f948a2aa236904119a48a9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.841103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f93ff1c1f948a2aa236904119a48a9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.852491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f93ff1c1f948a2aa236904119a48a9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.853671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-494cfc33-35ab-43ea-9d77-a40c220487f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f93ff1c1f948a2aa236904119a48a9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:07.872804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1212/2457] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:07 2022] DELETE /identity/v3/users/61f93ff1c1f948a2aa236904119a48a9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:08.217294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:08.219577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:08.239806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd116d-5837-4c53-b759-15fe1a1df7c9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:08.318922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:08.319910 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:08.320366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:08.320810 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] PATH_INFO: `/v3/projects/3d1b3dd3f13d406090946c26f1f7cd86` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:08.322254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1b3dd3f13d406090946c26f1f7cd86)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:08.325800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:08.397870 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1b3dd3f13d406090946c26f1f7cd86', 'request_id': 'req-442718bf-5fb0-454a-90fa-3c20e1a91d3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:08.407913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1b3dd3f13d406090946c26f1f7cd86', 'request_id': 'req-442718bf-5fb0-454a-90fa-3c20e1a91d3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:08.418804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1b3dd3f13d406090946c26f1f7cd86', 'request_id': 'req-442718bf-5fb0-454a-90fa-3c20e1a91d3b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:08.440420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] The token cache is being invalidate because project 3d1b3dd3f13d406090946c26f1f7cd86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:08.440677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:08.441595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-442718bf-5fb0-454a-90fa-3c20e1a91d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:08.446749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1246/2458] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:08 2022] DELETE /identity/v3/projects/3d1b3dd3f13d406090946c26f1f7cd86 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:08.449428 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305a15-56ba-45c5-a15b-9af0c143833d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:08.449585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305a15-56ba-45c5-a15b-9af0c143833d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:08.450756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305a15-56ba-45c5-a15b-9af0c143833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:08.476623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-19305a15-56ba-45c5-a15b-9af0c143833d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:08.478263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-19305a15-56ba-45c5-a15b-9af0c143833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:08.562079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1213/2459] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:08.570518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3313c1-742d-47d8-9ccd-30cd0bf7eaa4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:08.571207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3313c1-742d-47d8-9ccd-30cd0bf7eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:08.572165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3313c1-742d-47d8-9ccd-30cd0bf7eaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:08.600538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ef3313c1-742d-47d8-9ccd-30cd0bf7eaa4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:08.602875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ef3313c1-742d-47d8-9ccd-30cd0bf7eaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:08.618247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1247/2460] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:08.619634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305a15-56ba-45c5-a15b-9af0c143833d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:08.638698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305a15-56ba-45c5-a15b-9af0c143833d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:08.644577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf1e93-eea0-4ba1-9f4c-42e14cba0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:08.644577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf1e93-eea0-4ba1-9f4c-42e14cba0b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:08.644878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf1e93-eea0-4ba1-9f4c-42e14cba0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:08.644955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf1e93-eea0-4ba1-9f4c-42e14cba0b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:08.645598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf1e93-eea0-4ba1-9f4c-42e14cba0b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:08.645905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf1e93-eea0-4ba1-9f4c-42e14cba0b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:08.648009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf1e93-eea0-4ba1-9f4c-42e14cba0b4e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:08.664599 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1214/2461] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:47:08.667207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3313c1-742d-47d8-9ccd-30cd0bf7eaa4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:08.671801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:08.680286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3313c1-742d-47d8-9ccd-30cd0bf7eaa4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:08.689709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0958ad3-d466-41d5-a17a-0847661d570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:08.690419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0958ad3-d466-41d5-a17a-0847661d570a admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:08.690783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0958ad3-d466-41d5-a17a-0847661d570a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:08.691699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0958ad3-d466-41d5-a17a-0847661d570a admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:08.691856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0958ad3-d466-41d5-a17a-0847661d570a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:08.693941 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0958ad3-d466-41d5-a17a-0847661d570a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:08.734270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1248/2462] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:08 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:08.738670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf1e93-eea0-4ba1-9f4c-42e14cba0b4e admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:08.751995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf1e93-eea0-4ba1-9f4c-42e14cba0b4e admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:08.831204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033f36-550d-4fb4-9644-cccdab0bb4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:08.832621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033f36-550d-4fb4-9644-cccdab0bb4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:08.832621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033f36-550d-4fb4-9644-cccdab0bb4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:08.832933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033f36-550d-4fb4-9644-cccdab0bb4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:08.834044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f033f36-550d-4fb4-9644-cccdab0bb4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:08.835867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f033f36-550d-4fb4-9644-cccdab0bb4b9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:08.865089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1215/2463] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:08 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:08.870528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0958ad3-d466-41d5-a17a-0847661d570a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:08.882343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0958ad3-d466-41d5-a17a-0847661d570a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:08.892857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931e589-f8d6-4257-8125-3825a6e18e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:08.893966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931e589-f8d6-4257-8125-3825a6e18e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:08.894496 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931e589-f8d6-4257-8125-3825a6e18e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:08.895025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931e589-f8d6-4257-8125-3825a6e18e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:08.896106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931e589-f8d6-4257-8125-3825a6e18e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:08.898293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931e589-f8d6-4257-8125-3825a6e18e84 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:08.910981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1249/2464] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:08.916777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033f36-550d-4fb4-9644-cccdab0bb4b9 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:08.922978 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:08.929427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033f36-550d-4fb4-9644-cccdab0bb4b9 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:08.938731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590f85e-ba66-4803-a7b7-d4fcfc5ae6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:08.939846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590f85e-ba66-4803-a7b7-d4fcfc5ae6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:08.940400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590f85e-ba66-4803-a7b7-d4fcfc5ae6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:08.940926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590f85e-ba66-4803-a7b7-d4fcfc5ae6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:08.941921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590f85e-ba66-4803-a7b7-d4fcfc5ae6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:08.943861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590f85e-ba66-4803-a7b7-d4fcfc5ae6a0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:08.956687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1216/2465] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:08.960913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931e589-f8d6-4257-8125-3825a6e18e84 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:08.976309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931e589-f8d6-4257-8125-3825a6e18e84 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:08.991968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47482c7c-2483-4174-8169-d0ef2117be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:08.996254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47482c7c-2483-4174-8169-d0ef2117be45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:08.996930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47482c7c-2483-4174-8169-d0ef2117be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:08.997405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47482c7c-2483-4174-8169-d0ef2117be45 admin admin] PATH_INFO: `/v3/projects/73df9dac2e974ab7b0bf461e0c0b54db/users/cbc7cfdfc4944749a6a39ac925da1fa0/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:09.033904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47482c7c-2483-4174-8169-d0ef2117be45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73df9dac2e974ab7b0bf461e0c0b54db, user_id=cbc7cfdfc4944749a6a39ac925da1fa0, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:09.038537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47482c7c-2483-4174-8169-d0ef2117be45 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:09.060475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1250/2466] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:08 2022] PUT /identity/v3/projects/73df9dac2e974ab7b0bf461e0c0b54db/users/cbc7cfdfc4944749a6a39ac925da1fa0/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:09.072380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdf0f7-2e33-4e56-a746-b02322d52886 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:09.072798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdf0f7-2e33-4e56-a746-b02322d52886 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:09.073102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdf0f7-2e33-4e56-a746-b02322d52886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:09.081201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d497-a23b-4609-b336-5246b3207505 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:09.082557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d497-a23b-4609-b336-5246b3207505 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:09.082837 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d497-a23b-4609-b336-5246b3207505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:09.110836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-dbfdf0f7-2e33-4e56-a746-b02322d52886 None None] MFA Rules not processed for user `cbc7cfdfc4944749a6a39ac925da1fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:09.112516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-dbfdf0f7-2e33-4e56-a746-b02322d52886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:09.143157 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5313d497-a23b-4609-b336-5246b3207505 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:09.144429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5313d497-a23b-4609-b336-5246b3207505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:09.254639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1251/2467] 10.222.0.89 () {58 vars in 967 bytes} [Fri Aug 26 15:47:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:09.286339 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313d497-a23b-4609-b336-5246b3207505 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:09.296143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5313d497-a23b-4609-b336-5246b3207505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:09.303459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1217/2468] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:09.307961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdf0f7-2e33-4e56-a746-b02322d52886 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:09.420723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdf0f7-2e33-4e56-a746-b02322d52886 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:09.434357 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313d497-a23b-4609-b336-5246b3207505 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:09.436619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d053bd-4af1-4830-b5db-2d568a233165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:09.437360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d053bd-4af1-4830-b5db-2d568a233165 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:09.437648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d053bd-4af1-4830-b5db-2d568a233165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:09.437927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d053bd-4af1-4830-b5db-2d568a233165 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:09.439347 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d053bd-4af1-4830-b5db-2d568a233165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:09.446137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d053bd-4af1-4830-b5db-2d568a233165 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:09.451853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb2c33-6ab3-48b8-87d3-f9ada6bed4c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:09.452551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb2c33-6ab3-48b8-87d3-f9ada6bed4c8 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:09.452836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb2c33-6ab3-48b8-87d3-f9ada6bed4c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:09.453109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb2c33-6ab3-48b8-87d3-f9ada6bed4c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:09.472732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb2c33-6ab3-48b8-87d3-f9ada6bed4c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:09.475729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb2c33-6ab3-48b8-87d3-f9ada6bed4c8 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:09.492969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1252/2469] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:47:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:47:09.545911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1218/2470] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:09 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:09.550172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb2c33-6ab3-48b8-87d3-f9ada6bed4c8 service swift] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:09.568646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb2c33-6ab3-48b8-87d3-f9ada6bed4c8 service swift] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:09.693208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:09.753356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829d5f4-64c8-4399-92d3-c5f73bd5ed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:09.754191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d5f4-64c8-4399-92d3-c5f73bd5ed10 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:09.754471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d5f4-64c8-4399-92d3-c5f73bd5ed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:09.754802 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d5f4-64c8-4399-92d3-c5f73bd5ed10 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:09.755685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829d5f4-64c8-4399-92d3-c5f73bd5ed10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:09.757951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829d5f4-64c8-4399-92d3-c5f73bd5ed10 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:09.837275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1253/2471] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:09 2022] POST /identity/v3/users => generated 298 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:09.838906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d053bd-4af1-4830-b5db-2d568a233165 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:09.859489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d053bd-4af1-4830-b5db-2d568a233165 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:09.875545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9647da-1285-4e3c-880a-2fd7ba63adc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:09.879445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9647da-1285-4e3c-880a-2fd7ba63adc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:09.879723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9647da-1285-4e3c-880a-2fd7ba63adc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:09.880215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9647da-1285-4e3c-880a-2fd7ba63adc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:09.883158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9647da-1285-4e3c-880a-2fd7ba63adc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:09.885391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9647da-1285-4e3c-880a-2fd7ba63adc5 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:09.913223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1219/2472] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:09.919558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829d5f4-64c8-4399-92d3-c5f73bd5ed10 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:09.951611 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829d5f4-64c8-4399-92d3-c5f73bd5ed10 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:09.972792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16cd53-1de2-40a9-9cce-f6b0fb16ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:09.985439 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16cd53-1de2-40a9-9cce-f6b0fb16ec76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:09.985817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16cd53-1de2-40a9-9cce-f6b0fb16ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:09.986023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16cd53-1de2-40a9-9cce-f6b0fb16ec76 admin admin] PATH_INFO: `/v3/projects/6db2074fe53e49f192647d49069f547c/users/4b4a93fc24fe4d4d9e2ada01ef3bcd59/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.057859 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16cd53-1de2-40a9-9cce-f6b0fb16ec76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db2074fe53e49f192647d49069f547c, user_id=4b4a93fc24fe4d4d9e2ada01ef3bcd59, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:10.070523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16cd53-1de2-40a9-9cce-f6b0fb16ec76 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:10.089545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1254/2473] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:09 2022] PUT /identity/v3/projects/6db2074fe53e49f192647d49069f547c/users/4b4a93fc24fe4d4d9e2ada01ef3bcd59/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:10.095811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9647da-1285-4e3c-880a-2fd7ba63adc5 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:10.109405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9647da-1285-4e3c-880a-2fd7ba63adc5 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:10.245209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:10.261445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f9d37-b1b7-4051-9692-604c5cc15cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:10.262304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9d37-b1b7-4051-9692-604c5cc15cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:10.262549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9d37-b1b7-4051-9692-604c5cc15cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:10.262884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9d37-b1b7-4051-9692-604c5cc15cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.263577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f9d37-b1b7-4051-9692-604c5cc15cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:10.265232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f9d37-b1b7-4051-9692-604c5cc15cd4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:10.276331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1220/2474] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:10.282057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16cd53-1de2-40a9-9cce-f6b0fb16ec76 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:10.300255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16cd53-1de2-40a9-9cce-f6b0fb16ec76 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:10.313604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4fc1-d4b3-4019-a85b-2f9685cc2906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:10.315057 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4fc1-d4b3-4019-a85b-2f9685cc2906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:10.333391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4fc1-d4b3-4019-a85b-2f9685cc2906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:10.333856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4fc1-d4b3-4019-a85b-2f9685cc2906 admin admin] PATH_INFO: `/v3/projects/6db2074fe53e49f192647d49069f547c/users/4b4a93fc24fe4d4d9e2ada01ef3bcd59/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.336843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d4fc1-d4b3-4019-a85b-2f9685cc2906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db2074fe53e49f192647d49069f547c, user_id=4b4a93fc24fe4d4d9e2ada01ef3bcd59, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:10.340889 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d4fc1-d4b3-4019-a85b-2f9685cc2906 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:10.365799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1255/2475] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:10 2022] PUT /identity/v3/projects/6db2074fe53e49f192647d49069f547c/users/4b4a93fc24fe4d4d9e2ada01ef3bcd59/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:10.368485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330e73-e0b7-448e-8ce0-48c35e8a34ac None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:10.368701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330e73-e0b7-448e-8ce0-48c35e8a34ac None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:10.369392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330e73-e0b7-448e-8ce0-48c35e8a34ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.431851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-59330e73-e0b7-448e-8ce0-48c35e8a34ac None None] MFA Rules not processed for user `4b4a93fc24fe4d4d9e2ada01ef3bcd59`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:10.435416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-59330e73-e0b7-448e-8ce0-48c35e8a34ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:10.707034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1221/2476] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:10.725160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4fc1-d4b3-4019-a85b-2f9685cc2906 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:10.730691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5e8d4fc1-d4b3-4019-a85b-2f9685cc2906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:10.841882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4fc1-d4b3-4019-a85b-2f9685cc2906 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:10.847976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8bb6a-3420-49a1-a67a-b7250144592c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:10.848636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8bb6a-3420-49a1-a67a-b7250144592c service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:10.848915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8bb6a-3420-49a1-a67a-b7250144592c service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:10.849187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8bb6a-3420-49a1-a67a-b7250144592c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:10.868699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8bb6a-3420-49a1-a67a-b7250144592c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:10.870698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8bb6a-3420-49a1-a67a-b7250144592c service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:10.898319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1256/2477] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:11.037616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59330e73-e0b7-448e-8ce0-48c35e8a34ac None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:11.049088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59330e73-e0b7-448e-8ce0-48c35e8a34ac None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:11.053745 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85659eeb-f9b1-4acd-a0f7-47d4896c8b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:11.054688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85659eeb-f9b1-4acd-a0f7-47d4896c8b16 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:11.055901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85659eeb-f9b1-4acd-a0f7-47d4896c8b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:11.056486 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85659eeb-f9b1-4acd-a0f7-47d4896c8b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:11.194915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85659eeb-f9b1-4acd-a0f7-47d4896c8b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:11.197725 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85659eeb-f9b1-4acd-a0f7-47d4896c8b16 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:11.233266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1222/2478] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:11.810927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29b76e-f9b3-4e7b-b67c-f5cb30f333a4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:11.811745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29b76e-f9b3-4e7b-b67c-f5cb30f333a4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:11.811745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29b76e-f9b3-4e7b-b67c-f5cb30f333a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:11.884756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-dc29b76e-f9b3-4e7b-b67c-f5cb30f333a4 None None] MFA Rules not processed for user `757dce1558354968862f47eae45129bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:11.886012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dc29b76e-f9b3-4e7b-b67c-f5cb30f333a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:11.994611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85659eeb-f9b1-4acd-a0f7-47d4896c8b16 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.047353 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1257/2479] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:12.048968 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29b76e-f9b3-4e7b-b67c-f5cb30f333a4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.051645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dc29b76e-f9b3-4e7b-b67c-f5cb30f333a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:12.097561 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:12.156657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85659eeb-f9b1-4acd-a0f7-47d4896c8b16 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.172569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29b76e-f9b3-4e7b-b67c-f5cb30f333a4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.179012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e77cc-9bc0-4e40-b4e0-0f9694cdbede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.179788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e77cc-9bc0-4e40-b4e0-0f9694cdbede admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.180487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e77cc-9bc0-4e40-b4e0-0f9694cdbede admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.180872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e77cc-9bc0-4e40-b4e0-0f9694cdbede admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.181632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e77cc-9bc0-4e40-b4e0-0f9694cdbede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.185363 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e77cc-9bc0-4e40-b4e0-0f9694cdbede admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.188861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.189763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.190203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.190821 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] PATH_INFO: `/v3/users/cbc7cfdfc4944749a6a39ac925da1fa0` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.197048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc7cfdfc4944749a6a39ac925da1fa0)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.202835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.232239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1258/2480] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:12 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:12.235283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e77cc-9bc0-4e40-b4e0-0f9694cdbede admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.240063 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:12.310465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc7cfdfc4944749a6a39ac925da1fa0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.312550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc7cfdfc4944749a6a39ac925da1fa0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.339056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc7cfdfc4944749a6a39ac925da1fa0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.355810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc7cfdfc4944749a6a39ac925da1fa0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.356497 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-162f5186-f139-44f4-a950-1084bf76395d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc7cfdfc4944749a6a39ac925da1fa0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:12.369008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e77cc-9bc0-4e40-b4e0-0f9694cdbede admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.376824 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c4c8b-fe68-4029-bcb7-380db9d9bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.377486 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c4c8b-fe68-4029-bcb7-380db9d9bd16 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.377774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c4c8b-fe68-4029-bcb7-380db9d9bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.378145 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c4c8b-fe68-4029-bcb7-380db9d9bd16 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.378787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c4c8b-fe68-4029-bcb7-380db9d9bd16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.378990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1223/2481] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:11 2022] DELETE /identity/v3/users/cbc7cfdfc4944749a6a39ac925da1fa0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:12.381044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c4c8b-fe68-4029-bcb7-380db9d9bd16 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.381510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b60bc-1948-455b-b3f6-794740432b6a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.381898 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b60bc-1948-455b-b3f6-794740432b6a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.382184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b60bc-1948-455b-b3f6-794740432b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.416929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5c5b60bc-1948-455b-b3f6-794740432b6a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:12.421056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5c5b60bc-1948-455b-b3f6-794740432b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:12.428675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1259/2482] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:12 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:12.430598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c4c8b-fe68-4029-bcb7-380db9d9bd16 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.432620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-937c4c8b-fe68-4029-bcb7-380db9d9bd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:12.447071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c4c8b-fe68-4029-bcb7-380db9d9bd16 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.506763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1224/2483] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:12.520711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b60bc-1948-455b-b3f6-794740432b6a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.522851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5c5b60bc-1948-455b-b3f6-794740432b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:12.534645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19f47-3636-4595-94af-b28366e92fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.536280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19f47-3636-4595-94af-b28366e92fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.537672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19f47-3636-4595-94af-b28366e92fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.538195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19f47-3636-4595-94af-b28366e92fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.539446 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb19f47-3636-4595-94af-b28366e92fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.542587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb19f47-3636-4595-94af-b28366e92fd6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.557873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1260/2484] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:12.563180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19f47-3636-4595-94af-b28366e92fd6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.577487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19f47-3636-4595-94af-b28366e92fd6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.582613 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11549eb2-bf5d-4187-85f6-12f8982e5df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.583355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11549eb2-bf5d-4187-85f6-12f8982e5df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.583639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11549eb2-bf5d-4187-85f6-12f8982e5df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.584567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11549eb2-bf5d-4187-85f6-12f8982e5df2 admin admin] PATH_INFO: `/v3/projects/07a19f5ece914e55af30a25ce0812b33/users/1a120339c38a4980b78cf462e77045ed/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.606346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11549eb2-bf5d-4187-85f6-12f8982e5df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a19f5ece914e55af30a25ce0812b33, user_id=1a120339c38a4980b78cf462e77045ed, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.610208 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11549eb2-bf5d-4187-85f6-12f8982e5df2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.613823 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b60bc-1948-455b-b3f6-794740432b6a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.620593 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716a5ae-1800-49a8-af24-2b46222f5bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.622057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716a5ae-1800-49a8-af24-2b46222f5bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.622484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716a5ae-1800-49a8-af24-2b46222f5bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.622880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716a5ae-1800-49a8-af24-2b46222f5bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.631097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1261/2485] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:12 2022] PUT /identity/v3/projects/07a19f5ece914e55af30a25ce0812b33/users/1a120339c38a4980b78cf462e77045ed/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:12.636139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11549eb2-bf5d-4187-85f6-12f8982e5df2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.641545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716a5ae-1800-49a8-af24-2b46222f5bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.645947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716a5ae-1800-49a8-af24-2b46222f5bb5 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.652745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:12.664502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1225/2486] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:12.739514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11549eb2-bf5d-4187-85f6-12f8982e5df2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.745541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745372fe-e4ea-45c2-afdc-e92746163b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.746761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745372fe-e4ea-45c2-afdc-e92746163b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.747280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745372fe-e4ea-45c2-afdc-e92746163b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.747675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745372fe-e4ea-45c2-afdc-e92746163b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.748429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745372fe-e4ea-45c2-afdc-e92746163b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.750268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745372fe-e4ea-45c2-afdc-e92746163b36 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.762610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1262/2487] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:12.766994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716a5ae-1800-49a8-af24-2b46222f5bb5 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:12.782424 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716a5ae-1800-49a8-af24-2b46222f5bb5 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:12.790197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e53b3-5893-418b-966d-ca5ae64ccf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:12.791750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e53b3-5893-418b-966d-ca5ae64ccf10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:12.792381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e53b3-5893-418b-966d-ca5ae64ccf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:12.793737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e53b3-5893-418b-966d-ca5ae64ccf10 admin admin] PATH_INFO: `/v3/projects/07a19f5ece914e55af30a25ce0812b33/users/1a120339c38a4980b78cf462e77045ed/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:12.797812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e53b3-5893-418b-966d-ca5ae64ccf10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a19f5ece914e55af30a25ce0812b33, user_id=1a120339c38a4980b78cf462e77045ed, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:12.818325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e53b3-5893-418b-966d-ca5ae64ccf10 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:12.854138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1226/2488] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:12 2022] PUT /identity/v3/projects/07a19f5ece914e55af30a25ce0812b33/users/1a120339c38a4980b78cf462e77045ed/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:13.184507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745372fe-e4ea-45c2-afdc-e92746163b36 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.187320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-745372fe-e4ea-45c2-afdc-e92746163b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:13.234865 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745372fe-e4ea-45c2-afdc-e92746163b36 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.322525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.324788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.325826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.325826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] PATH_INFO: `/v3/projects/73df9dac2e974ab7b0bf461e0c0b54db` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.328203 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73df9dac2e974ab7b0bf461e0c0b54db)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.331673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.407216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73df9dac2e974ab7b0bf461e0c0b54db', 'request_id': 'req-054d91a3-3ced-4f71-b60e-89796e2f4ff1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.419073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73df9dac2e974ab7b0bf461e0c0b54db', 'request_id': 'req-054d91a3-3ced-4f71-b60e-89796e2f4ff1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.441608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73df9dac2e974ab7b0bf461e0c0b54db', 'request_id': 'req-054d91a3-3ced-4f71-b60e-89796e2f4ff1'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.472579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] The token cache is being invalidate because project 73df9dac2e974ab7b0bf461e0c0b54db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:13.473108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.476923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.483017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1263/2489] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:13 2022] DELETE /identity/v3/projects/73df9dac2e974ab7b0bf461e0c0b54db => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:13.487147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e53b3-5893-418b-966d-ca5ae64ccf10 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:13.492109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-750e53b3-5893-418b-966d-ca5ae64ccf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:13.507035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e53b3-5893-418b-966d-ca5ae64ccf10 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:13.533262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:13.594160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:13.594825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:13.595142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:13.595423 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] PATH_INFO: `/v3/users/4b4a93fc24fe4d4d9e2ada01ef3bcd59` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:13.597078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4a93fc24fe4d4d9e2ada01ef3bcd59)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:13.599669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:13.688246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4a93fc24fe4d4d9e2ada01ef3bcd59'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.688999 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4a93fc24fe4d4d9e2ada01ef3bcd59'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.705185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4a93fc24fe4d4d9e2ada01ef3bcd59'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.714103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4a93fc24fe4d4d9e2ada01ef3bcd59'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.714827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-c6f6e3f6-fc95-4452-91b0-b54cba5b81a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4a93fc24fe4d4d9e2ada01ef3bcd59'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:13.733073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1227/2490] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:13 2022] DELETE /identity/v3/users/4b4a93fc24fe4d4d9e2ada01ef3bcd59 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:14.150367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.167117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d91a3-3ced-4f71-b60e-89796e2f4ff1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.226098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:14.283732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.284381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.284658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.284924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] PATH_INFO: `/v3/projects/6db2074fe53e49f192647d49069f547c` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.286578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db2074fe53e49f192647d49069f547c)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.290283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.383243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db2074fe53e49f192647d49069f547c', 'request_id': 'req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:14.394227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db2074fe53e49f192647d49069f547c', 'request_id': 'req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:14.407452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db2074fe53e49f192647d49069f547c', 'request_id': 'req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:14.430610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] The token cache is being invalidate because project 6db2074fe53e49f192647d49069f547c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:14.430983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:14.431654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9442e789-54dc-4bf1-b8cd-bf0ecf61a279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:14.438286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1264/2491] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:14 2022] DELETE /identity/v3/projects/6db2074fe53e49f192647d49069f547c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:14.439413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a6d0b-97c5-42ce-959d-dca0b8bfc0c9 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.439668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a6d0b-97c5-42ce-959d-dca0b8bfc0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.439951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a6d0b-97c5-42ce-959d-dca0b8bfc0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.500980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-d33a6d0b-97c5-42ce-959d-dca0b8bfc0c9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:14.502273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d33a6d0b-97c5-42ce-959d-dca0b8bfc0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:14.586219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1228/2492] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:14.595798 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8111ff-e3b3-4aa6-b812-55f93300fa7d None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.596078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8111ff-e3b3-4aa6-b812-55f93300fa7d None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.596385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8111ff-e3b3-4aa6-b812-55f93300fa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.618354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ca8111ff-e3b3-4aa6-b812-55f93300fa7d None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:14.619738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ca8111ff-e3b3-4aa6-b812-55f93300fa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:14.628921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1265/2493] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:14.635068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a6d0b-97c5-42ce-959d-dca0b8bfc0c9 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.651327 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a6d0b-97c5-42ce-959d-dca0b8bfc0c9 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.657498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b4b6d-da7a-4434-95d0-fe29eeb0114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.658616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b4b6d-da7a-4434-95d0-fe29eeb0114e admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.659136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b4b6d-da7a-4434-95d0-fe29eeb0114e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.659615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b4b6d-da7a-4434-95d0-fe29eeb0114e admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.660508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b4b6d-da7a-4434-95d0-fe29eeb0114e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:14.661017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b4b6d-da7a-4434-95d0-fe29eeb0114e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.662979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b4b6d-da7a-4434-95d0-fe29eeb0114e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.678550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1229/2494] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:14.683389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8111ff-e3b3-4aa6-b812-55f93300fa7d None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.694886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8111ff-e3b3-4aa6-b812-55f93300fa7d None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.703124 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5a8fa-89fd-4fa9-8dcd-6458a9de2d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.703995 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a8fa-89fd-4fa9-8dcd-6458a9de2d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.704598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a8fa-89fd-4fa9-8dcd-6458a9de2d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.705209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a8fa-89fd-4fa9-8dcd-6458a9de2d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.706000 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5a8fa-89fd-4fa9-8dcd-6458a9de2d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.708554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5a8fa-89fd-4fa9-8dcd-6458a9de2d36 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.750827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1266/2495] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:14 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:14.756175 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b4b6d-da7a-4434-95d0-fe29eeb0114e admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.782653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b4b6d-da7a-4434-95d0-fe29eeb0114e admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.842732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:14.900929 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75ffc0-3f9e-4044-9420-7b5a34363804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.902079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75ffc0-3f9e-4044-9420-7b5a34363804 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.902427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75ffc0-3f9e-4044-9420-7b5a34363804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.902709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75ffc0-3f9e-4044-9420-7b5a34363804 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.903869 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75ffc0-3f9e-4044-9420-7b5a34363804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.906094 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75ffc0-3f9e-4044-9420-7b5a34363804 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.938203 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1230/2496] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:14 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:14.943719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5a8fa-89fd-4fa9-8dcd-6458a9de2d36 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.957689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5a8fa-89fd-4fa9-8dcd-6458a9de2d36 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:14.965790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4b162-d3cf-4170-a9f6-a0aa0f01ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:14.965790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4b162-d3cf-4170-a9f6-a0aa0f01ba9e admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:14.965790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4b162-d3cf-4170-a9f6-a0aa0f01ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:14.965790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4b162-d3cf-4170-a9f6-a0aa0f01ba9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:14.966477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4b162-d3cf-4170-a9f6-a0aa0f01ba9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:14.968741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4b162-d3cf-4170-a9f6-a0aa0f01ba9e admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:14.982781 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1267/2497] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:14.986924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75ffc0-3f9e-4044-9420-7b5a34363804 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:14.998051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75ffc0-3f9e-4044-9420-7b5a34363804 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:15.005165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e000c-dcdd-4c4b-9965-e9fbf0c54bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:15.006127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e000c-dcdd-4c4b-9965-e9fbf0c54bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:15.006249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e000c-dcdd-4c4b-9965-e9fbf0c54bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:15.007148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e000c-dcdd-4c4b-9965-e9fbf0c54bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:15.007310 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e000c-dcdd-4c4b-9965-e9fbf0c54bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:15.009525 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e000c-dcdd-4c4b-9965-e9fbf0c54bcb admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:15.025210 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1231/2498] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:15.026510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4b162-d3cf-4170-a9f6-a0aa0f01ba9e admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:15.040626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4b162-d3cf-4170-a9f6-a0aa0f01ba9e admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:15.045877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398e8c2-7198-486f-bafe-cc41d29ad121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:15.046647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398e8c2-7198-486f-bafe-cc41d29ad121 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:15.046927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398e8c2-7198-486f-bafe-cc41d29ad121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:15.047234 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398e8c2-7198-486f-bafe-cc41d29ad121 admin admin] PATH_INFO: `/v3/projects/d5ff3e384f61459fbf4bf29a1c6f0e96/users/d7384c9fd3ed43e2b22f0bca00ef090c/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:15.068962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398e8c2-7198-486f-bafe-cc41d29ad121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ff3e384f61459fbf4bf29a1c6f0e96, user_id=d7384c9fd3ed43e2b22f0bca00ef090c, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:15.073048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398e8c2-7198-486f-bafe-cc41d29ad121 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:15.112212 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1268/2499] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:15 2022] PUT /identity/v3/projects/d5ff3e384f61459fbf4bf29a1c6f0e96/users/d7384c9fd3ed43e2b22f0bca00ef090c/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:15.123706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc3c3b-639b-47b2-8b00-4aa73e4ded10 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:15.124042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc3c3b-639b-47b2-8b00-4aa73e4ded10 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:15.124446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc3c3b-639b-47b2-8b00-4aa73e4ded10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:15.157653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8fdc3c3b-639b-47b2-8b00-4aa73e4ded10 None None] MFA Rules not processed for user `d7384c9fd3ed43e2b22f0bca00ef090c`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:15.159238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8fdc3c3b-639b-47b2-8b00-4aa73e4ded10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:15.258100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1232/2500] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:15.263441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398e8c2-7198-486f-bafe-cc41d29ad121 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:15.377162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398e8c2-7198-486f-bafe-cc41d29ad121 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:15.389362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d18520-26c4-4082-94f3-5cccd051497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:15.389362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d18520-26c4-4082-94f3-5cccd051497f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:15.389362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d18520-26c4-4082-94f3-5cccd051497f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:15.389362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d18520-26c4-4082-94f3-5cccd051497f admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:15.390743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d18520-26c4-4082-94f3-5cccd051497f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:15.390743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d18520-26c4-4082-94f3-5cccd051497f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:15.404717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:15.438222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1269/2501] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:15 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:15.444448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc3c3b-639b-47b2-8b00-4aa73e4ded10 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:15.460231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc3c3b-639b-47b2-8b00-4aa73e4ded10 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:15.539696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6c38-5a4e-4c67-9893-f42e281be7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:15.540583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6c38-5a4e-4c67-9893-f42e281be7bb admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:15.540943 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6c38-5a4e-4c67-9893-f42e281be7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:15.541482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6c38-5a4e-4c67-9893-f42e281be7bb admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:15.542208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f6c38-5a4e-4c67-9893-f42e281be7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:15.544861 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f6c38-5a4e-4c67-9893-f42e281be7bb admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:15.585716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1233/2502] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:15 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:15.589958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d18520-26c4-4082-94f3-5cccd051497f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:15.600666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d18520-26c4-4082-94f3-5cccd051497f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:15.605737 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221c55a-c454-48e7-9582-3ca94043a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:15.606366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221c55a-c454-48e7-9582-3ca94043a61b admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:15.606646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221c55a-c454-48e7-9582-3ca94043a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:15.607054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221c55a-c454-48e7-9582-3ca94043a61b admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:15.607702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221c55a-c454-48e7-9582-3ca94043a61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:15.609318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221c55a-c454-48e7-9582-3ca94043a61b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:15.621490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1270/2503] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:15.625844 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6c38-5a4e-4c67-9893-f42e281be7bb admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:15.638970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6c38-5a4e-4c67-9893-f42e281be7bb admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:15.645661 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e641f-d3e9-43a7-939e-058494a43b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:15.646788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e641f-d3e9-43a7-939e-058494a43b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:15.646788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e641f-d3e9-43a7-939e-058494a43b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:15.647259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e641f-d3e9-43a7-939e-058494a43b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:15.648363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e641f-d3e9-43a7-939e-058494a43b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:15.650739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e641f-d3e9-43a7-939e-058494a43b3f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:15.663333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1234/2504] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:15.667940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221c55a-c454-48e7-9582-3ca94043a61b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:15.681883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221c55a-c454-48e7-9582-3ca94043a61b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:15.689400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b8c3d-09a2-4350-a1ab-eb5c752b6538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:15.690809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b8c3d-09a2-4350-a1ab-eb5c752b6538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:15.690809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b8c3d-09a2-4350-a1ab-eb5c752b6538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:15.690809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b8c3d-09a2-4350-a1ab-eb5c752b6538 admin admin] PATH_INFO: `/v3/projects/5c4699f524954c518df3ff9361c1c877/users/6fab836a48ee4472a9c5a4f2b2876c15/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:15.713657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b8c3d-09a2-4350-a1ab-eb5c752b6538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4699f524954c518df3ff9361c1c877, user_id=6fab836a48ee4472a9c5a4f2b2876c15, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:15.717997 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b8c3d-09a2-4350-a1ab-eb5c752b6538 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:15.738012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1271/2505] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:15 2022] PUT /identity/v3/projects/5c4699f524954c518df3ff9361c1c877/users/6fab836a48ee4472a9c5a4f2b2876c15/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:15.750668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704064b4-71d5-4dda-b58f-73b1335c2da5 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:15.751518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704064b4-71d5-4dda-b58f-73b1335c2da5 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:15.752092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704064b4-71d5-4dda-b58f-73b1335c2da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:15.830180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-704064b4-71d5-4dda-b58f-73b1335c2da5 None None] MFA Rules not processed for user `6fab836a48ee4472a9c5a4f2b2876c15`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:15.830180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-704064b4-71d5-4dda-b58f-73b1335c2da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:15.838380 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:15.938583 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1235/2506] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:15.943196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b8c3d-09a2-4350-a1ab-eb5c752b6538 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:16.034624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b8c3d-09a2-4350-a1ab-eb5c752b6538 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:16.039990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4182e-1640-4093-b98d-93f0bd62d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:16.040897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4182e-1640-4093-b98d-93f0bd62d4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:16.041325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4182e-1640-4093-b98d-93f0bd62d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:16.041771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4182e-1640-4093-b98d-93f0bd62d4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:16.043316 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4182e-1640-4093-b98d-93f0bd62d4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:16.045622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4182e-1640-4093-b98d-93f0bd62d4d8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:16.115882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1272/2507] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:15 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:16.117434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704064b4-71d5-4dda-b58f-73b1335c2da5 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:16.144654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704064b4-71d5-4dda-b58f-73b1335c2da5 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:16.293394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9842c2-6407-4fa6-9ee5-16c645b9590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:16.294207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9842c2-6407-4fa6-9ee5-16c645b9590c admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:16.297019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9842c2-6407-4fa6-9ee5-16c645b9590c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:16.297320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9842c2-6407-4fa6-9ee5-16c645b9590c admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:16.298015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9842c2-6407-4fa6-9ee5-16c645b9590c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:16.306482 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9842c2-6407-4fa6-9ee5-16c645b9590c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:16.366688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1236/2508] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:16 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:16.372981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4182e-1640-4093-b98d-93f0bd62d4d8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:16.387216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4182e-1640-4093-b98d-93f0bd62d4d8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:16.408735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e7e6f-ba88-4ff0-b695-992b9778a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:16.409788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e7e6f-ba88-4ff0-b695-992b9778a7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:16.410059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e7e6f-ba88-4ff0-b695-992b9778a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:16.410616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e7e6f-ba88-4ff0-b695-992b9778a7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:16.411687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e7e6f-ba88-4ff0-b695-992b9778a7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:16.414551 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e7e6f-ba88-4ff0-b695-992b9778a7f5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:16.436243 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1273/2509] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:16.440596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9842c2-6407-4fa6-9ee5-16c645b9590c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:16.454768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9842c2-6407-4fa6-9ee5-16c645b9590c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:16.460787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04e1f1-4693-4b4f-a4c8-8ac9648b4db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:16.461818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e1f1-4693-4b4f-a4c8-8ac9648b4db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:16.462135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e1f1-4693-4b4f-a4c8-8ac9648b4db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:16.462377 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e1f1-4693-4b4f-a4c8-8ac9648b4db1 admin admin] PATH_INFO: `/v3/projects/8431644c158d442b894b3dfed4adda55/users/5e124b819e204623b6aa8382b21989e8/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:16.482306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04e1f1-4693-4b4f-a4c8-8ac9648b4db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8431644c158d442b894b3dfed4adda55, user_id=5e124b819e204623b6aa8382b21989e8, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:16.485970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04e1f1-4693-4b4f-a4c8-8ac9648b4db1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:16.516737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1237/2510] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:16 2022] PUT /identity/v3/projects/8431644c158d442b894b3dfed4adda55/users/5e124b819e204623b6aa8382b21989e8/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:16.517902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e7e6f-ba88-4ff0-b695-992b9778a7f5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:16.541216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e7e6f-ba88-4ff0-b695-992b9778a7f5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:16.662647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07129453-2b8e-4c7e-8cc5-8c15140e6088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:16.663322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07129453-2b8e-4c7e-8cc5-8c15140e6088 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:16.663634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07129453-2b8e-4c7e-8cc5-8c15140e6088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:16.663907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07129453-2b8e-4c7e-8cc5-8c15140e6088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:16.664807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07129453-2b8e-4c7e-8cc5-8c15140e6088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:16.667564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07129453-2b8e-4c7e-8cc5-8c15140e6088 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:16.687288 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1274/2511] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:16.689564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04e1f1-4693-4b4f-a4c8-8ac9648b4db1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:16.703080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04e1f1-4693-4b4f-a4c8-8ac9648b4db1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:16.708256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd047463-683e-440b-bb33-b1f4b12cd8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:16.709108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd047463-683e-440b-bb33-b1f4b12cd8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:16.709379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd047463-683e-440b-bb33-b1f4b12cd8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:16.710010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd047463-683e-440b-bb33-b1f4b12cd8b3 admin admin] PATH_INFO: `/v3/projects/8431644c158d442b894b3dfed4adda55/users/5e124b819e204623b6aa8382b21989e8/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:16.712176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd047463-683e-440b-bb33-b1f4b12cd8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8431644c158d442b894b3dfed4adda55, user_id=5e124b819e204623b6aa8382b21989e8, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:16.715215 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd047463-683e-440b-bb33-b1f4b12cd8b3 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:16.744060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1238/2512] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:16 2022] PUT /identity/v3/projects/8431644c158d442b894b3dfed4adda55/users/5e124b819e204623b6aa8382b21989e8/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:16.746845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772cd5-7b4d-448b-b99c-888eceed49f0 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:16.747169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772cd5-7b4d-448b-b99c-888eceed49f0 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:16.747435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772cd5-7b4d-448b-b99c-888eceed49f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:16.819242 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6c772cd5-7b4d-448b-b99c-888eceed49f0 None None] MFA Rules not processed for user `5e124b819e204623b6aa8382b21989e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:16.822055 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6c772cd5-7b4d-448b-b99c-888eceed49f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:16.856093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:16.970987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1275/2513] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:16.985358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd047463-683e-440b-bb33-b1f4b12cd8b3 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:16.988117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-cd047463-683e-440b-bb33-b1f4b12cd8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:17.125233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd047463-683e-440b-bb33-b1f4b12cd8b3 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:17.138000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d25d3-6f9f-4634-b914-3577192ae845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:17.138711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d25d3-6f9f-4634-b914-3577192ae845 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:17.139081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d25d3-6f9f-4634-b914-3577192ae845 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:17.139381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d25d3-6f9f-4634-b914-3577192ae845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:17.160090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:17.296698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d25d3-6f9f-4634-b914-3577192ae845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:17.311273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d25d3-6f9f-4634-b914-3577192ae845 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:17.325079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1239/2514] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:19.413503 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772cd5-7b4d-448b-b99c-888eceed49f0 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:19.415070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6c772cd5-7b4d-448b-b99c-888eceed49f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:19.433110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772cd5-7b4d-448b-b99c-888eceed49f0 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:19.442980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e51f1-51f4-4859-a4e5-213768568e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:19.443877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e51f1-51f4-4859-a4e5-213768568e30 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:19.444428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e51f1-51f4-4859-a4e5-213768568e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:19.444863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e51f1-51f4-4859-a4e5-213768568e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:19.568797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e51f1-51f4-4859-a4e5-213768568e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:19.573535 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e51f1-51f4-4859-a4e5-213768568e30 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:19.591823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1276/2515] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:19.674890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b339ed-d596-42ee-be86-054f61271fab None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:19.675822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b339ed-d596-42ee-be86-054f61271fab None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:19.676816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b339ed-d596-42ee-be86-054f61271fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:19.749565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-72b339ed-d596-42ee-be86-054f61271fab None None] MFA Rules not processed for user `1a120339c38a4980b78cf462e77045ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:19.751110 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-72b339ed-d596-42ee-be86-054f61271fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:19.939436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1240/2516] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:20.029249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e51f1-51f4-4859-a4e5-213768568e30 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:20.032502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1a7e51f1-51f4-4859-a4e5-213768568e30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:20.141489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e51f1-51f4-4859-a4e5-213768568e30 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:20.149471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4495fbb-5f19-4f37-b811-ebefea9778d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d055337c9a642bd9b8b5a60aacb11cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:20.150181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4495fbb-5f19-4f37-b811-ebefea9778d1 service glance] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:20.150534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4495fbb-5f19-4f37-b811-ebefea9778d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:20.150897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4495fbb-5f19-4f37-b811-ebefea9778d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:20.158200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f4495fbb-5f19-4f37-b811-ebefea9778d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:20.251294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4495fbb-5f19-4f37-b811-ebefea9778d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:20.252917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4495fbb-5f19-4f37-b811-ebefea9778d1 service glance] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:20.265330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1277/2517] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:20.515682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf6da5-df5d-42fc-8989-4db4e113284a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:20.516624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf6da5-df5d-42fc-8989-4db4e113284a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:20.517091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf6da5-df5d-42fc-8989-4db4e113284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:20.565775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-f9cf6da5-df5d-42fc-8989-4db4e113284a None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:20.573176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f9cf6da5-df5d-42fc-8989-4db4e113284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:20.620390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4495fbb-5f19-4f37-b811-ebefea9778d1 service glance] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:20.629828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:20.655047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4495fbb-5f19-4f37-b811-ebefea9778d1 service glance] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:20.668384 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6c29a-ffb3-47fc-bf44-e262fb2433ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:20.669811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c29a-ffb3-47fc-bf44-e262fb2433ac service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:20.676908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c29a-ffb3-47fc-bf44-e262fb2433ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:20.677780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c29a-ffb3-47fc-bf44-e262fb2433ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:20.699123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6c29a-ffb3-47fc-bf44-e262fb2433ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:20.702755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6c29a-ffb3-47fc-bf44-e262fb2433ac service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:20.723717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1278/2518] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:20.736784 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1241/2519] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:47:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:20.746194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6c29a-ffb3-47fc-bf44-e262fb2433ac service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:20.748098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e9a6c29a-ffb3-47fc-bf44-e262fb2433ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:20.865148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6c29a-ffb3-47fc-bf44-e262fb2433ac service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:20.878668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58822217-133a-4f33-a670-2f54b192b057 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:20.879471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58822217-133a-4f33-a670-2f54b192b057 service swift] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:20.879856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58822217-133a-4f33-a670-2f54b192b057 service swift] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:20.880385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58822217-133a-4f33-a670-2f54b192b057 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:20.897075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58822217-133a-4f33-a670-2f54b192b057 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:20.898963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58822217-133a-4f33-a670-2f54b192b057 service swift] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:20.910351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1279/2520] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:47:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:47:25.117868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf6da5-df5d-42fc-8989-4db4e113284a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:25.177539 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:25.202814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf6da5-df5d-42fc-8989-4db4e113284a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:25.209130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:25.210028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:25.210464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:25.210923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] PATH_INFO: `/v3/users/d7384c9fd3ed43e2b22f0bca00ef090c` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:25.212136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7384c9fd3ed43e2b22f0bca00ef090c)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:25.214099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:25.271834 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7384c9fd3ed43e2b22f0bca00ef090c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:25.273009 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7384c9fd3ed43e2b22f0bca00ef090c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:25.293948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7384c9fd3ed43e2b22f0bca00ef090c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:25.302679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7384c9fd3ed43e2b22f0bca00ef090c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:25.303370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7384c9fd3ed43e2b22f0bca00ef090c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:25.339187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1242/2521] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:25 2022] DELETE /identity/v3/users/d7384c9fd3ed43e2b22f0bca00ef090c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:25.345235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146563b2-e56b-4a8f-8dc7-5ec74061d03a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:25.345743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146563b2-e56b-4a8f-8dc7-5ec74061d03a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:25.345860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146563b2-e56b-4a8f-8dc7-5ec74061d03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:25.368121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-146563b2-e56b-4a8f-8dc7-5ec74061d03a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:25.369642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-146563b2-e56b-4a8f-8dc7-5ec74061d03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:25.464123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1280/2522] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:25.474544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:25.476646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:25.586843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5a04c-2c9a-403c-a3df-b7aab25feb5b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:25.593135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340b2a2-74b0-4d10-baa9-70936983689a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:25.593828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340b2a2-74b0-4d10-baa9-70936983689a service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:25.594122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340b2a2-74b0-4d10-baa9-70936983689a service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:25.594409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340b2a2-74b0-4d10-baa9-70936983689a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:25.607550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340b2a2-74b0-4d10-baa9-70936983689a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:25.609128 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340b2a2-74b0-4d10-baa9-70936983689a service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:25.636535 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1243/2523] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:26.001131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146563b2-e56b-4a8f-8dc7-5ec74061d03a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:26.003680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-146563b2-e56b-4a8f-8dc7-5ec74061d03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:26.034618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146563b2-e56b-4a8f-8dc7-5ec74061d03a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:26.048450 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:26.051691 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:26.052019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:26.052479 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] PATH_INFO: `/v3/projects/d5ff3e384f61459fbf4bf29a1c6f0e96` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:26.053728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ff3e384f61459fbf4bf29a1c6f0e96)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:26.056182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:26.118065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ff3e384f61459fbf4bf29a1c6f0e96', 'request_id': 'req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.127193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ff3e384f61459fbf4bf29a1c6f0e96', 'request_id': 'req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.141264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ff3e384f61459fbf4bf29a1c6f0e96', 'request_id': 'req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.158015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] The token cache is being invalidate because project d5ff3e384f61459fbf4bf29a1c6f0e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:26.158454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.165214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.165214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1281/2524] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:25 2022] DELETE /identity/v3/projects/d5ff3e384f61459fbf4bf29a1c6f0e96 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:26.165529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340b2a2-74b0-4d10-baa9-70936983689a service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:26.178422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340b2a2-74b0-4d10-baa9-70936983689a service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:26.255190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:26.256319 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:26.256754 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:26.257123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] PATH_INFO: `/v3/users/6fab836a48ee4472a9c5a4f2b2876c15` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:26.258447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fab836a48ee4472a9c5a4f2b2876c15)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:26.263270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:26.269714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:26.333295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fab836a48ee4472a9c5a4f2b2876c15'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.334054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fab836a48ee4472a9c5a4f2b2876c15'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.355668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fab836a48ee4472a9c5a4f2b2876c15'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.372918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fab836a48ee4472a9c5a4f2b2876c15'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.374447 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fab836a48ee4472a9c5a4f2b2876c15'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.391182 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1244/2525] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:26 2022] DELETE /identity/v3/users/6fab836a48ee4472a9c5a4f2b2876c15 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:26.745150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:26.747097 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:26.759109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:26.797574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae22450-ecb5-4c47-920d-4a1ab226ed0f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:26.875526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:26.876990 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:26.915263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:26.916241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:26.916556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:26.916843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] PATH_INFO: `/v3/projects/5c4699f524954c518df3ff9361c1c877` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:26.918779 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4699f524954c518df3ff9361c1c877)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:26.923970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:26.991176 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4699f524954c518df3ff9361c1c877', 'request_id': 'req-848b943d-076a-49c9-8bed-c088a4c0a83b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:26.993536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6228127-1599-43e7-8b4d-c3235bfda7b7 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:26.997647 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4699f524954c518df3ff9361c1c877', 'request_id': 'req-848b943d-076a-49c9-8bed-c088a4c0a83b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.006627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4699f524954c518df3ff9361c1c877', 'request_id': 'req-848b943d-076a-49c9-8bed-c088a4c0a83b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.021376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] The token cache is being invalidate because project 5c4699f524954c518df3ff9361c1c877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:27.021663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.022317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.024920 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1282/2526] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:26 2022] DELETE /identity/v3/projects/5c4699f524954c518df3ff9361c1c877 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:27.029621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.031533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:27.068170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59154-4172-4fd1-98dc-6f9d5f5c3c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.069614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59154-4172-4fd1-98dc-6f9d5f5c3c7c service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.069797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59154-4172-4fd1-98dc-6f9d5f5c3c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.070079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59154-4172-4fd1-98dc-6f9d5f5c3c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.072135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d2d59154-4172-4fd1-98dc-6f9d5f5c3c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:27.127703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b943d-076a-49c9-8bed-c088a4c0a83b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.134735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.135838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.136264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.137171 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] PATH_INFO: `/v3/users/5e124b819e204623b6aa8382b21989e8` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.139164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:27.142377 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e124b819e204623b6aa8382b21989e8)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.144455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.158501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59154-4172-4fd1-98dc-6f9d5f5c3c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.160008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59154-4172-4fd1-98dc-6f9d5f5c3c7c service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.175073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1245/2527] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:27.196483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:27.209758 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e124b819e204623b6aa8382b21989e8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.229699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e124b819e204623b6aa8382b21989e8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.232142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e124b819e204623b6aa8382b21989e8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.256828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e124b819e204623b6aa8382b21989e8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.258232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-09596e3f-284d-49a2-b8fb-35c41cbc1776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e124b819e204623b6aa8382b21989e8'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.278425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1283/2528] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:27 2022] DELETE /identity/v3/users/5e124b819e204623b6aa8382b21989e8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:27.698350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59154-4172-4fd1-98dc-6f9d5f5c3c7c service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:27.734313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59154-4172-4fd1-98dc-6f9d5f5c3c7c service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:27.811724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:27.812409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.812777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.812922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] PATH_INFO: `/v3/projects/8431644c158d442b894b3dfed4adda55` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.814114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8431644c158d442b894b3dfed4adda55)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:27.816354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:27.882040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8431644c158d442b894b3dfed4adda55', 'request_id': 'req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.891392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8431644c158d442b894b3dfed4adda55', 'request_id': 'req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.904982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8431644c158d442b894b3dfed4adda55', 'request_id': 'req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.917467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] The token cache is being invalidate because project 8431644c158d442b894b3dfed4adda55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:27.918442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.919234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-9cfbf87b-ffea-4e4e-ae92-924ca61ec705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:27.921163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1246/2529] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:27 2022] DELETE /identity/v3/projects/8431644c158d442b894b3dfed4adda55 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:27.925819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcce3d-a222-4f9b-bd9f-893a9b5ec05e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:27.926338 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcce3d-a222-4f9b-bd9f-893a9b5ec05e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:27.926437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcce3d-a222-4f9b-bd9f-893a9b5ec05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:27.954538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f2bcce3d-a222-4f9b-bd9f-893a9b5ec05e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:27.955808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f2bcce3d-a222-4f9b-bd9f-893a9b5ec05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:28.040345 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1284/2530] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:28.048254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f6ca-b927-49aa-a8ae-d548418f18a4 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:28.048552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f6ca-b927-49aa-a8ae-d548418f18a4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:28.048857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f6ca-b927-49aa-a8ae-d548418f18a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:28.072864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-0b86f6ca-b927-49aa-a8ae-d548418f18a4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:28.074649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-0b86f6ca-b927-49aa-a8ae-d548418f18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:28.083798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1247/2531] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:28.087754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcce3d-a222-4f9b-bd9f-893a9b5ec05e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:28.100285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcce3d-a222-4f9b-bd9f-893a9b5ec05e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:28.105937 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fdd82-86fc-4b73-a2d6-b7b15cd3813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:28.112006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fdd82-86fc-4b73-a2d6-b7b15cd3813b admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:28.112412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fdd82-86fc-4b73-a2d6-b7b15cd3813b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:28.112698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fdd82-86fc-4b73-a2d6-b7b15cd3813b admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:28.113398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fdd82-86fc-4b73-a2d6-b7b15cd3813b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:28.113704 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fdd82-86fc-4b73-a2d6-b7b15cd3813b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:28.115368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fdd82-86fc-4b73-a2d6-b7b15cd3813b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:28.130473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1285/2532] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:28.134862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86f6ca-b927-49aa-a8ae-d548418f18a4 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:28.145031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86f6ca-b927-49aa-a8ae-d548418f18a4 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:28.157291 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a006b3-e351-4803-8169-ca8b752eb3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:28.157997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a006b3-e351-4803-8169-ca8b752eb3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:28.158287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a006b3-e351-4803-8169-ca8b752eb3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:28.158564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a006b3-e351-4803-8169-ca8b752eb3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:28.159391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a006b3-e351-4803-8169-ca8b752eb3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:28.161414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a006b3-e351-4803-8169-ca8b752eb3c3 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:28.204112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1248/2533] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:28 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:28.207908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fdd82-86fc-4b73-a2d6-b7b15cd3813b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:28.219143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fdd82-86fc-4b73-a2d6-b7b15cd3813b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:28.308028 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de46dc-ab66-4ca3-a15a-b2ecdec25357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:28.309517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de46dc-ab66-4ca3-a15a-b2ecdec25357 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:28.309863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de46dc-ab66-4ca3-a15a-b2ecdec25357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:28.310335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de46dc-ab66-4ca3-a15a-b2ecdec25357 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:28.311285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de46dc-ab66-4ca3-a15a-b2ecdec25357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:28.313364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de46dc-ab66-4ca3-a15a-b2ecdec25357 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:28.353133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1286/2534] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:28 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:28.357081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a006b3-e351-4803-8169-ca8b752eb3c3 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:28.373413 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a006b3-e351-4803-8169-ca8b752eb3c3 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:28.381159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696159f-e372-477b-a428-65e7577720b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:28.393900 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696159f-e372-477b-a428-65e7577720b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:28.394397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696159f-e372-477b-a428-65e7577720b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:28.394829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696159f-e372-477b-a428-65e7577720b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:28.395720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696159f-e372-477b-a428-65e7577720b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:28.398019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696159f-e372-477b-a428-65e7577720b4 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:28.418839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1249/2535] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:28.419819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de46dc-ab66-4ca3-a15a-b2ecdec25357 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:28.432681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de46dc-ab66-4ca3-a15a-b2ecdec25357 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:28.438641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578586c9-0320-4902-830e-d843aca769a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:28.439578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578586c9-0320-4902-830e-d843aca769a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:28.440065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578586c9-0320-4902-830e-d843aca769a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:28.440533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578586c9-0320-4902-830e-d843aca769a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:28.441383 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578586c9-0320-4902-830e-d843aca769a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:28.443425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578586c9-0320-4902-830e-d843aca769a5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:28.460557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1287/2536] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:28.460917 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696159f-e372-477b-a428-65e7577720b4 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:28.477046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696159f-e372-477b-a428-65e7577720b4 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:28.492670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706905d-5452-42dc-b180-ddbf5fc27001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:28.493244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706905d-5452-42dc-b180-ddbf5fc27001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:28.493529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706905d-5452-42dc-b180-ddbf5fc27001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:28.493925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706905d-5452-42dc-b180-ddbf5fc27001 admin admin] PATH_INFO: `/v3/projects/6bfd0cbb9ec84d70898a6ddc48f7a52a/users/c01f2e5585ba41e8b3947177030a4759/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:28.524937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706905d-5452-42dc-b180-ddbf5fc27001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfd0cbb9ec84d70898a6ddc48f7a52a, user_id=c01f2e5585ba41e8b3947177030a4759, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:28.529571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706905d-5452-42dc-b180-ddbf5fc27001 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:28.560246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1250/2537] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:28 2022] PUT /identity/v3/projects/6bfd0cbb9ec84d70898a6ddc48f7a52a/users/c01f2e5585ba41e8b3947177030a4759/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:28.565475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f3a9-af72-4c07-b2f7-db4e672bae3e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:28.565882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f3a9-af72-4c07-b2f7-db4e672bae3e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:28.566156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f3a9-af72-4c07-b2f7-db4e672bae3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:28.587510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3295f3a9-af72-4c07-b2f7-db4e672bae3e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:28.588812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3295f3a9-af72-4c07-b2f7-db4e672bae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:28.621082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:28.719163 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1288/2538] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:28.728338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706905d-5452-42dc-b180-ddbf5fc27001 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:28.730817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f706905d-5452-42dc-b180-ddbf5fc27001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:28.768026 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:28.841379 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706905d-5452-42dc-b180-ddbf5fc27001 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:28.847409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602a2dc-fb65-400d-b1d1-051bbcf56acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:28.848235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602a2dc-fb65-400d-b1d1-051bbcf56acb service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:28.848554 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602a2dc-fb65-400d-b1d1-051bbcf56acb service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:28.848843 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602a2dc-fb65-400d-b1d1-051bbcf56acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:28.864587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602a2dc-fb65-400d-b1d1-051bbcf56acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:28.866053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602a2dc-fb65-400d-b1d1-051bbcf56acb service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:28.879053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1251/2539] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:30.019235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046edfb-047a-4540-85f4-3e67be8bd315 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:30.019728 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046edfb-047a-4540-85f4-3e67be8bd315 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:30.019825 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046edfb-047a-4540-85f4-3e67be8bd315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:30.057240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f046edfb-047a-4540-85f4-3e67be8bd315 None None] MFA Rules not processed for user `c01f2e5585ba41e8b3947177030a4759`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:30.058605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f046edfb-047a-4540-85f4-3e67be8bd315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:30.177702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1289/2540] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:30.190552 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602a2dc-fb65-400d-b1d1-051bbcf56acb service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:30.192032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c602a2dc-fb65-400d-b1d1-051bbcf56acb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:30.369474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602a2dc-fb65-400d-b1d1-051bbcf56acb service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:30.378765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb6c3f-9a61-4409-b8ff-f063b1677845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:30.379774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb6c3f-9a61-4409-b8ff-f063b1677845 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:30.381711 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb6c3f-9a61-4409-b8ff-f063b1677845 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:30.382597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb6c3f-9a61-4409-b8ff-f063b1677845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:30.412463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb6c3f-9a61-4409-b8ff-f063b1677845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:30.419455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb6c3f-9a61-4409-b8ff-f063b1677845 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:30.441184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1252/2541] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:31.748801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046edfb-047a-4540-85f4-3e67be8bd315 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:31.750498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f046edfb-047a-4540-85f4-3e67be8bd315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:31.849599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046edfb-047a-4540-85f4-3e67be8bd315 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:31.866369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb6c3f-9a61-4409-b8ff-f063b1677845 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:31.866898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc928758-49fd-4a11-8478-4b45f63d0c5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:31.867695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc928758-49fd-4a11-8478-4b45f63d0c5e service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:31.867882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc928758-49fd-4a11-8478-4b45f63d0c5e service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:31.868167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc928758-49fd-4a11-8478-4b45f63d0c5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:31.868985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-30cb6c3f-9a61-4409-b8ff-f063b1677845 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:31.870302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bc928758-49fd-4a11-8478-4b45f63d0c5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:31.886544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc928758-49fd-4a11-8478-4b45f63d0c5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:31.888588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc928758-49fd-4a11-8478-4b45f63d0c5e service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:31.890907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb6c3f-9a61-4409-b8ff-f063b1677845 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:31.898284 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:31.899388 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:31.899985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:31.900271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] PATH_INFO: `/v3/users/e56d4b78d51b4a81842f5724aaff7f85` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:31.901498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56d4b78d51b4a81842f5724aaff7f85)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:31.904299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:31.904686 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1290/2542] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:31.994048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56d4b78d51b4a81842f5724aaff7f85'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:31.994852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56d4b78d51b4a81842f5724aaff7f85'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:32.009921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56d4b78d51b4a81842f5724aaff7f85'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:32.021343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56d4b78d51b4a81842f5724aaff7f85'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:32.022142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56d4b78d51b4a81842f5724aaff7f85'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:32.047704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1253/2543] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:31 2022] DELETE /identity/v3/users/e56d4b78d51b4a81842f5724aaff7f85 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:32.101617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b45eb-5e14-4183-b89b-87c0e502f714 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:32.101904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b45eb-5e14-4183-b89b-87c0e502f714 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:32.102187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b45eb-5e14-4183-b89b-87c0e502f714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.148726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d82b45eb-5e14-4183-b89b-87c0e502f714 None None] MFA Rules not processed for user `c01f2e5585ba41e8b3947177030a4759`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:32.149956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d82b45eb-5e14-4183-b89b-87c0e502f714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:32.224418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:32.259008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1291/2544] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:32.348151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:32.349951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:32.411826 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:32.447381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ebac2-3f91-49af-945e-08b8b7c07fa0 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:32.454870 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:32.455657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:32.455942 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:32.456219 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] PATH_INFO: `/v3/projects/bdd49a5192474cdcaf8759423837547b` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.457451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd49a5192474cdcaf8759423837547b)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:32.459584 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:32.515956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd49a5192474cdcaf8759423837547b', 'request_id': 'req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:32.525735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd49a5192474cdcaf8759423837547b', 'request_id': 'req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:32.534288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd49a5192474cdcaf8759423837547b', 'request_id': 'req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:32.548254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] The token cache is being invalidate because project bdd49a5192474cdcaf8759423837547b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:32.549172 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:32.549871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1f5871c3-7e3e-4f3c-a298-ab1cc6311168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:32.551756 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1254/2545] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:32 2022] DELETE /identity/v3/projects/bdd49a5192474cdcaf8759423837547b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:32.561939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed63c1-752e-440f-99d4-55b31b5fdbac None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:32.562500 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed63c1-752e-440f-99d4-55b31b5fdbac None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:32.562500 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed63c1-752e-440f-99d4-55b31b5fdbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.587335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-64ed63c1-752e-440f-99d4-55b31b5fdbac None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:32.588722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-64ed63c1-752e-440f-99d4-55b31b5fdbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:32.670048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1292/2546] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:32.673322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eda77-ea1a-4a60-b26a-f36577ad35ba None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:32.673615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eda77-ea1a-4a60-b26a-f36577ad35ba None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:32.674045 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eda77-ea1a-4a60-b26a-f36577ad35ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.694979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-775eda77-ea1a-4a60-b26a-f36577ad35ba None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:32.696180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-775eda77-ea1a-4a60-b26a-f36577ad35ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:32.705807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1255/2547] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:32.710144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed63c1-752e-440f-99d4-55b31b5fdbac None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:32.720763 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed63c1-752e-440f-99d4-55b31b5fdbac None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:32.725434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9d09-4b4d-416d-8807-918c8fc6adb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:32.726044 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9d09-4b4d-416d-8807-918c8fc6adb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:32.726321 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9d09-4b4d-416d-8807-918c8fc6adb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:32.726742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9d09-4b4d-416d-8807-918c8fc6adb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.727371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9d09-4b4d-416d-8807-918c8fc6adb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:32.727677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9d09-4b4d-416d-8807-918c8fc6adb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:32.731003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9d09-4b4d-416d-8807-918c8fc6adb0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:32.746982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1293/2548] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:47:32.750720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775eda77-ea1a-4a60-b26a-f36577ad35ba None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:32.760581 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775eda77-ea1a-4a60-b26a-f36577ad35ba None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:32.766204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e325ad0-61e8-4f75-85a0-a0e3981f12d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:32.766833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325ad0-61e8-4f75-85a0-a0e3981f12d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:32.767115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325ad0-61e8-4f75-85a0-a0e3981f12d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:32.767391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325ad0-61e8-4f75-85a0-a0e3981f12d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.768028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e325ad0-61e8-4f75-85a0-a0e3981f12d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:32.770102 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e325ad0-61e8-4f75-85a0-a0e3981f12d1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:32.784171 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488822e5-c65a-4af3-b3d9-4a0c1906a579 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:32.785108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488822e5-c65a-4af3-b3d9-4a0c1906a579 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:32.785108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488822e5-c65a-4af3-b3d9-4a0c1906a579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.806796 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-488822e5-c65a-4af3-b3d9-4a0c1906a579 None None] MFA Rules not processed for user `757dce1558354968862f47eae45129bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:32.808064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-488822e5-c65a-4af3-b3d9-4a0c1906a579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:32.812799 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1256/2549] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:32 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:32.813476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e325ad0-61e8-4f75-85a0-a0e3981f12d1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:32.884375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1294/2550] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:32.893234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e325ad0-61e8-4f75-85a0-a0e3981f12d1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:32.900187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30804d72-d4da-4b3d-aaca-0f87e0ebdd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:32.900856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30804d72-d4da-4b3d-aaca-0f87e0ebdd4f admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:32.901180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30804d72-d4da-4b3d-aaca-0f87e0ebdd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:32.901425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30804d72-d4da-4b3d-aaca-0f87e0ebdd4f admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.902147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30804d72-d4da-4b3d-aaca-0f87e0ebdd4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:32.904422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30804d72-d4da-4b3d-aaca-0f87e0ebdd4f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:32.928136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1257/2551] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:32 2022] POST /identity/v3/users => generated 281 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:32.932077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488822e5-c65a-4af3-b3d9-4a0c1906a579 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:32.945400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488822e5-c65a-4af3-b3d9-4a0c1906a579 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:32.951756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c751-be71-4b1e-aa69-dec54a124b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:32.959726 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c751-be71-4b1e-aa69-dec54a124b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:32.960197 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c751-be71-4b1e-aa69-dec54a124b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:32.960574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c751-be71-4b1e-aa69-dec54a124b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:32.961391 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258c751-be71-4b1e-aa69-dec54a124b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:32.963324 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258c751-be71-4b1e-aa69-dec54a124b64 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:32.984667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1295/2552] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:32.988720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30804d72-d4da-4b3d-aaca-0f87e0ebdd4f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.000819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30804d72-d4da-4b3d-aaca-0f87e0ebdd4f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:33.008358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3022bd6-1edf-4a6b-9462-ec22124a7f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:33.008641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3022bd6-1edf-4a6b-9462-ec22124a7f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.008750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3022bd6-1edf-4a6b-9462-ec22124a7f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.008954 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3022bd6-1edf-4a6b-9462-ec22124a7f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.009615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3022bd6-1edf-4a6b-9462-ec22124a7f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:33.011275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3022bd6-1edf-4a6b-9462-ec22124a7f82 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:33.023233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1258/2553] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:33.027524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c751-be71-4b1e-aa69-dec54a124b64 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.041211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c751-be71-4b1e-aa69-dec54a124b64 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:33.046981 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11abf0d-925f-4474-8097-32c91d85ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:33.048822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11abf0d-925f-4474-8097-32c91d85ea1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.049219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11abf0d-925f-4474-8097-32c91d85ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.049607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11abf0d-925f-4474-8097-32c91d85ea1c admin admin] PATH_INFO: `/v3/projects/6415002514ae4b88a05604c8185a00dd/users/450c71e0d339473aa1a2ab6da8b7bea4/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.069380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11abf0d-925f-4474-8097-32c91d85ea1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6415002514ae4b88a05604c8185a00dd, user_id=450c71e0d339473aa1a2ab6da8b7bea4, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:33.072322 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11abf0d-925f-4474-8097-32c91d85ea1c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:33.086927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1296/2554] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:33 2022] PUT /identity/v3/projects/6415002514ae4b88a05604c8185a00dd/users/450c71e0d339473aa1a2ab6da8b7bea4/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:33.097060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedddba-0e45-47d1-a2eb-67be3f2faf9f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.097466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedddba-0e45-47d1-a2eb-67be3f2faf9f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.097723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedddba-0e45-47d1-a2eb-67be3f2faf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.147109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4fedddba-0e45-47d1-a2eb-67be3f2faf9f None None] MFA Rules not processed for user `450c71e0d339473aa1a2ab6da8b7bea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:33.148902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4fedddba-0e45-47d1-a2eb-67be3f2faf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:33.155100 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:33.235781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1259/2555] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:33.241309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11abf0d-925f-4474-8097-32c91d85ea1c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.242258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedddba-0e45-47d1-a2eb-67be3f2faf9f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.246706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4fedddba-0e45-47d1-a2eb-67be3f2faf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:33.295593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:33.326789 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11abf0d-925f-4474-8097-32c91d85ea1c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:33.332277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf7609-c599-47fc-9669-f3232becb884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:33.332794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedddba-0e45-47d1-a2eb-67be3f2faf9f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:33.333497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf7609-c599-47fc-9669-f3232becb884 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.333497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf7609-c599-47fc-9669-f3232becb884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.333847 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf7609-c599-47fc-9669-f3232becb884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.334605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf7609-c599-47fc-9669-f3232becb884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:33.336858 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf7609-c599-47fc-9669-f3232becb884 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:33.340151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6450-8458-470f-98e7-b6b85f792c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:33.341149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6450-8458-470f-98e7-b6b85f792c03 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.341149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6450-8458-470f-98e7-b6b85f792c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.341492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6450-8458-470f-98e7-b6b85f792c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.344251 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-fd3c6450-8458-470f-98e7-b6b85f792c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:33.357652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6450-8458-470f-98e7-b6b85f792c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:33.359607 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6450-8458-470f-98e7-b6b85f792c03 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:33.372023 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1297/2556] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:33 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:33.372940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1260/2557] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:33.380063 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf7609-c599-47fc-9669-f3232becb884 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.467984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf7609-c599-47fc-9669-f3232becb884 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:33.474445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2d1e-f58c-4903-ba57-0abfcbbc03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:33.476229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2d1e-f58c-4903-ba57-0abfcbbc03a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.476229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2d1e-f58c-4903-ba57-0abfcbbc03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.476229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2d1e-f58c-4903-ba57-0abfcbbc03a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.479464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2d1e-f58c-4903-ba57-0abfcbbc03a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:33.482659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2d1e-f58c-4903-ba57-0abfcbbc03a3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:33.515162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1298/2558] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:33 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:33.520841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6450-8458-470f-98e7-b6b85f792c03 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.533696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6450-8458-470f-98e7-b6b85f792c03 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:33.539698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2e40-dc38-4b36-8863-ccba692d1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:33.540819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2e40-dc38-4b36-8863-ccba692d1cab admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.540819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2e40-dc38-4b36-8863-ccba692d1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.541427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da2e40-dc38-4b36-8863-ccba692d1cab admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.542026 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da2e40-dc38-4b36-8863-ccba692d1cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:33.544289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da2e40-dc38-4b36-8863-ccba692d1cab admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:33.555224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1261/2559] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:33.560091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2d1e-f58c-4903-ba57-0abfcbbc03a3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.571787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2d1e-f58c-4903-ba57-0abfcbbc03a3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:33.577621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05a34a-29ca-4bb0-bdf5-b3523b8d7d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:33.578300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a34a-29ca-4bb0-bdf5-b3523b8d7d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.578654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a34a-29ca-4bb0-bdf5-b3523b8d7d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.578921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a34a-29ca-4bb0-bdf5-b3523b8d7d94 admin admin] PATH_INFO: `/v3/projects/1a405fb2f9a149f6a4d56cb172ab318a/users/7f0eebf4c7ea4f7caf80ecbd73ab61e8/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.598913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05a34a-29ca-4bb0-bdf5-b3523b8d7d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a405fb2f9a149f6a4d56cb172ab318a, user_id=7f0eebf4c7ea4f7caf80ecbd73ab61e8, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:33.602222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05a34a-29ca-4bb0-bdf5-b3523b8d7d94 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:33.619795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1299/2560] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:33 2022] PUT /identity/v3/projects/1a405fb2f9a149f6a4d56cb172ab318a/users/7f0eebf4c7ea4f7caf80ecbd73ab61e8/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:33.623500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2e40-dc38-4b36-8863-ccba692d1cab admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.633767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da2e40-dc38-4b36-8863-ccba692d1cab admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:33.710012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e00a3-cacb-4cfa-ab02-b887d7a19704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:33.710632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e00a3-cacb-4cfa-ab02-b887d7a19704 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.710913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e00a3-cacb-4cfa-ab02-b887d7a19704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.712313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e00a3-cacb-4cfa-ab02-b887d7a19704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.713168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e00a3-cacb-4cfa-ab02-b887d7a19704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:33.715358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e00a3-cacb-4cfa-ab02-b887d7a19704 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:33.751260 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1262/2561] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:33.752804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05a34a-29ca-4bb0-bdf5-b3523b8d7d94 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.765533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05a34a-29ca-4bb0-bdf5-b3523b8d7d94 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:33.770283 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597957b-2ec4-4b14-9341-3b4b9f8a2b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:33.771106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597957b-2ec4-4b14-9341-3b4b9f8a2b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.771241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597957b-2ec4-4b14-9341-3b4b9f8a2b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.771515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597957b-2ec4-4b14-9341-3b4b9f8a2b3c admin admin] PATH_INFO: `/v3/projects/1a405fb2f9a149f6a4d56cb172ab318a/users/7f0eebf4c7ea4f7caf80ecbd73ab61e8/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.773727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597957b-2ec4-4b14-9341-3b4b9f8a2b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a405fb2f9a149f6a4d56cb172ab318a, user_id=7f0eebf4c7ea4f7caf80ecbd73ab61e8, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:33.776950 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597957b-2ec4-4b14-9341-3b4b9f8a2b3c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:33.808907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1300/2562] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:33 2022] PUT /identity/v3/projects/1a405fb2f9a149f6a4d56cb172ab318a/users/7f0eebf4c7ea4f7caf80ecbd73ab61e8/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:33.812242 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e135c79-1291-4ff5-aea0-4be458a0267b None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:33.812644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e135c79-1291-4ff5-aea0-4be458a0267b None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:33.813170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e135c79-1291-4ff5-aea0-4be458a0267b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:33.848617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7e135c79-1291-4ff5-aea0-4be458a0267b None None] MFA Rules not processed for user `7f0eebf4c7ea4f7caf80ecbd73ab61e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:33.849920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7e135c79-1291-4ff5-aea0-4be458a0267b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:33.873241 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:33.932109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1263/2563] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:33.944590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597957b-2ec4-4b14-9341-3b4b9f8a2b3c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:33.946312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7597957b-2ec4-4b14-9341-3b4b9f8a2b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:34.013516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597957b-2ec4-4b14-9341-3b4b9f8a2b3c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:34.017138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efd1e0-39bd-4c80-9b49-bcf97df8fd34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:34.017743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efd1e0-39bd-4c80-9b49-bcf97df8fd34 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:34.018021 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efd1e0-39bd-4c80-9b49-bcf97df8fd34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:34.018291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efd1e0-39bd-4c80-9b49-bcf97df8fd34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:34.027904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efd1e0-39bd-4c80-9b49-bcf97df8fd34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:34.029656 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efd1e0-39bd-4c80-9b49-bcf97df8fd34 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:34.040244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1301/2564] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:34.133450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e135c79-1291-4ff5-aea0-4be458a0267b None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:34.145902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e135c79-1291-4ff5-aea0-4be458a0267b None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:34.150566 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b8690-15bb-4f37-b022-3be6a7cc95cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:34.151262 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8690-15bb-4f37-b022-3be6a7cc95cb service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:34.151545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8690-15bb-4f37-b022-3be6a7cc95cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:34.152483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8690-15bb-4f37-b022-3be6a7cc95cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:34.223391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b8690-15bb-4f37-b022-3be6a7cc95cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:34.224846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b8690-15bb-4f37-b022-3be6a7cc95cb service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:34.235033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1264/2565] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:35.633047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30315195-0ab6-419e-ad8a-38d1843373d5 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:35.633596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30315195-0ab6-419e-ad8a-38d1843373d5 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:35.633596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30315195-0ab6-419e-ad8a-38d1843373d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:35.658172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-30315195-0ab6-419e-ad8a-38d1843373d5 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:35.659433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-30315195-0ab6-419e-ad8a-38d1843373d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:35.677060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:35.731514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1302/2566] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:47:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:35.751527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b8690-15bb-4f37-b022-3be6a7cc95cb service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:35.755502 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-784b8690-15bb-4f37-b022-3be6a7cc95cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:35.882568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b8690-15bb-4f37-b022-3be6a7cc95cb service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:35.906305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca1757-1d83-4d27-b521-0c4f3f818bab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:35.907207 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1757-1d83-4d27-b521-0c4f3f818bab service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:35.907518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1757-1d83-4d27-b521-0c4f3f818bab service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:35.908568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1757-1d83-4d27-b521-0c4f3f818bab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:35.920040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca1757-1d83-4d27-b521-0c4f3f818bab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:35.921666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca1757-1d83-4d27-b521-0c4f3f818bab service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:35.931063 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1265/2567] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:47:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:47:36.506364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30315195-0ab6-419e-ad8a-38d1843373d5 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:36.508489 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-30315195-0ab6-419e-ad8a-38d1843373d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:36.694386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30315195-0ab6-419e-ad8a-38d1843373d5 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:36.705863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26c621-35f5-4fab-9741-23b89b590c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:36.706505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26c621-35f5-4fab-9741-23b89b590c57 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:36.706785 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26c621-35f5-4fab-9741-23b89b590c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:36.707087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26c621-35f5-4fab-9741-23b89b590c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:36.708985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fe26c621-35f5-4fab-9741-23b89b590c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:36.891244 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26c621-35f5-4fab-9741-23b89b590c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:36.893415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26c621-35f5-4fab-9741-23b89b590c57 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:36.930177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1303/2568] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:41.194332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca1757-1d83-4d27-b521-0c4f3f818bab service swift] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:41.257406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:41.276702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca1757-1d83-4d27-b521-0c4f3f818bab service swift] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:41.282923 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:41.283897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:41.284344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:41.284703 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] PATH_INFO: `/v3/users/450c71e0d339473aa1a2ab6da8b7bea4` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:41.286099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=450c71e0d339473aa1a2ab6da8b7bea4)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:41.288455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:41.398500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450c71e0d339473aa1a2ab6da8b7bea4'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:41.399435 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450c71e0d339473aa1a2ab6da8b7bea4'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:41.416757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450c71e0d339473aa1a2ab6da8b7bea4'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:41.439214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450c71e0d339473aa1a2ab6da8b7bea4'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:41.439214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450c71e0d339473aa1a2ab6da8b7bea4'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:41.467040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1266/2569] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:41 2022] DELETE /identity/v3/users/450c71e0d339473aa1a2ab6da8b7bea4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:41.472120 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ead084-1eb0-42d7-935a-9e4697188fef None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:41.473527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ead084-1eb0-42d7-935a-9e4697188fef None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:41.474201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ead084-1eb0-42d7-935a-9e4697188fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:41.514984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c0ead084-1eb0-42d7-935a-9e4697188fef None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:41.518370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c0ead084-1eb0-42d7-935a-9e4697188fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:41.677987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1304/2570] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:41.686199 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:41.688127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:41.790549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e37a49-70b0-4af8-8c67-a5bda8726d04 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:41.799585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd62bf-3e5d-47ca-8424-2ba8668e984d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:41.799585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd62bf-3e5d-47ca-8424-2ba8668e984d service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:41.799585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd62bf-3e5d-47ca-8424-2ba8668e984d service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:41.799585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd62bf-3e5d-47ca-8424-2ba8668e984d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:41.814090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd62bf-3e5d-47ca-8424-2ba8668e984d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:41.818151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd62bf-3e5d-47ca-8424-2ba8668e984d service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:41.838670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1267/2571] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:42.195934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ead084-1eb0-42d7-935a-9e4697188fef None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:42.198052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c0ead084-1eb0-42d7-935a-9e4697188fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:42.219473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ead084-1eb0-42d7-935a-9e4697188fef None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:42.226456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:42.227658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:42.228027 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:42.228207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] PATH_INFO: `/v3/projects/6415002514ae4b88a05604c8185a00dd` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:42.229984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6415002514ae4b88a05604c8185a00dd)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:42.232222 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:42.263368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:42.309552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6415002514ae4b88a05604c8185a00dd', 'request_id': 'req-8442f5fa-bb74-4ee4-8378-1f21f294935a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.320068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6415002514ae4b88a05604c8185a00dd', 'request_id': 'req-8442f5fa-bb74-4ee4-8378-1f21f294935a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.340240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6415002514ae4b88a05604c8185a00dd', 'request_id': 'req-8442f5fa-bb74-4ee4-8378-1f21f294935a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.356119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] The token cache is being invalidate because project 6415002514ae4b88a05604c8185a00dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:42.356396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.357172 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.363374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1305/2572] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:42 2022] DELETE /identity/v3/projects/6415002514ae4b88a05604c8185a00dd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:42.365016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd62bf-3e5d-47ca-8424-2ba8668e984d service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:42.381167 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd62bf-3e5d-47ca-8424-2ba8668e984d service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:42.455833 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:42.456773 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:42.457234 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:42.457671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] PATH_INFO: `/v3/users/7f0eebf4c7ea4f7caf80ecbd73ab61e8` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:42.459072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0eebf4c7ea4f7caf80ecbd73ab61e8)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:42.462499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:42.477015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:42.550165 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0eebf4c7ea4f7caf80ecbd73ab61e8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.550955 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0eebf4c7ea4f7caf80ecbd73ab61e8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.574575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0eebf4c7ea4f7caf80ecbd73ab61e8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.585289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0eebf4c7ea4f7caf80ecbd73ab61e8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.586074 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2ca34de2-1180-4a14-b83d-e8f35fe0e3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0eebf4c7ea4f7caf80ecbd73ab61e8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:42.616616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1268/2573] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:42 2022] DELETE /identity/v3/users/7f0eebf4c7ea4f7caf80ecbd73ab61e8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:43.189252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:43.190993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:43.210957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442f5fa-bb74-4ee4-8378-1f21f294935a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:43.316453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:43.317255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:43.317560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:43.317881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] PATH_INFO: `/v3/projects/1a405fb2f9a149f6a4d56cb172ab318a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:43.319245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a405fb2f9a149f6a4d56cb172ab318a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:43.321264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:43.380332 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a405fb2f9a149f6a4d56cb172ab318a', 'request_id': 'req-9bcfd6c7-39fc-4498-80cb-155f9f77f583'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:43.388952 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a405fb2f9a149f6a4d56cb172ab318a', 'request_id': 'req-9bcfd6c7-39fc-4498-80cb-155f9f77f583'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:43.399069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a405fb2f9a149f6a4d56cb172ab318a', 'request_id': 'req-9bcfd6c7-39fc-4498-80cb-155f9f77f583'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:43.415528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] The token cache is being invalidate because project 1a405fb2f9a149f6a4d56cb172ab318a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:43.415795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:43.418661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-9bcfd6c7-39fc-4498-80cb-155f9f77f583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:43.420931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1306/2574] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:43 2022] DELETE /identity/v3/projects/1a405fb2f9a149f6a4d56cb172ab318a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:43.425894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f7831-a1b7-46cb-a0c5-5c267d8602fe None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:43.426927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f7831-a1b7-46cb-a0c5-5c267d8602fe None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:43.426927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f7831-a1b7-46cb-a0c5-5c267d8602fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:43.450867 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8f9f7831-a1b7-46cb-a0c5-5c267d8602fe None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:43.452879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8f9f7831-a1b7-46cb-a0c5-5c267d8602fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:43.548266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1269/2575] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:43.558404 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3190e3-6f7c-45ec-9f1e-42d966cba3a9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:43.558860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3190e3-6f7c-45ec-9f1e-42d966cba3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:43.559355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3190e3-6f7c-45ec-9f1e-42d966cba3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:43.593592 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ec3190e3-6f7c-45ec-9f1e-42d966cba3a9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:43.595383 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ec3190e3-6f7c-45ec-9f1e-42d966cba3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:43.604015 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1307/2576] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:43.611228 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f7831-a1b7-46cb-a0c5-5c267d8602fe None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:43.626707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f7831-a1b7-46cb-a0c5-5c267d8602fe None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:43.633296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aacd9-620d-4b60-89bf-7bf81a66103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:43.634099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aacd9-620d-4b60-89bf-7bf81a66103d admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:43.634493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aacd9-620d-4b60-89bf-7bf81a66103d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:43.634881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aacd9-620d-4b60-89bf-7bf81a66103d admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:43.635850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aacd9-620d-4b60-89bf-7bf81a66103d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:43.636973 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aacd9-620d-4b60-89bf-7bf81a66103d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:43.640003 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aacd9-620d-4b60-89bf-7bf81a66103d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:43.656488 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1270/2577] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:47:43.663962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3190e3-6f7c-45ec-9f1e-42d966cba3a9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:43.678585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3190e3-6f7c-45ec-9f1e-42d966cba3a9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:43.685616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aace02-7f59-4583-b4a6-5b8cc7d48b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:43.686372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aace02-7f59-4583-b4a6-5b8cc7d48b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:43.686795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aace02-7f59-4583-b4a6-5b8cc7d48b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:43.687262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aace02-7f59-4583-b4a6-5b8cc7d48b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:43.688641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aace02-7f59-4583-b4a6-5b8cc7d48b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:43.691644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aace02-7f59-4583-b4a6-5b8cc7d48b73 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:43.734980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1308/2578] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:43 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:43.737375 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aacd9-620d-4b60-89bf-7bf81a66103d admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:43.754926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aacd9-620d-4b60-89bf-7bf81a66103d admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:43.879472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943ff89-5948-4f15-a302-482a8f427f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:43.880614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943ff89-5948-4f15-a302-482a8f427f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:43.882988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943ff89-5948-4f15-a302-482a8f427f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:43.883400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943ff89-5948-4f15-a302-482a8f427f5a admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:43.884179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943ff89-5948-4f15-a302-482a8f427f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:43.886450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943ff89-5948-4f15-a302-482a8f427f5a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:43.927574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1271/2579] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:43 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:43.933196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aace02-7f59-4583-b4a6-5b8cc7d48b73 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:43.943273 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:43.947407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aace02-7f59-4583-b4a6-5b8cc7d48b73 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:43.959179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b50f8-91b4-44a8-bc0f-be5ed84aad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:43.960134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b50f8-91b4-44a8-bc0f-be5ed84aad3f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:43.960658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b50f8-91b4-44a8-bc0f-be5ed84aad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:43.961266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b50f8-91b4-44a8-bc0f-be5ed84aad3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:43.962289 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b50f8-91b4-44a8-bc0f-be5ed84aad3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:43.965358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b50f8-91b4-44a8-bc0f-be5ed84aad3f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:43.984427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1309/2580] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:43.992918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943ff89-5948-4f15-a302-482a8f427f5a admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:44.001517 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:44.006320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943ff89-5948-4f15-a302-482a8f427f5a admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:44.014805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2218359-4148-4b40-8751-43dc2856ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:44.015481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2218359-4148-4b40-8751-43dc2856ff82 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:44.017400 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2218359-4148-4b40-8751-43dc2856ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:44.017745 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2218359-4148-4b40-8751-43dc2856ff82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:44.018332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2218359-4148-4b40-8751-43dc2856ff82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:44.031113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2218359-4148-4b40-8751-43dc2856ff82 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:44.042470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1272/2581] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:44.046411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b50f8-91b4-44a8-bc0f-be5ed84aad3f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:44.068932 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b50f8-91b4-44a8-bc0f-be5ed84aad3f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:44.099514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a93e5-5bd9-44b6-a8b0-f995eaa1da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:44.100782 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a93e5-5bd9-44b6-a8b0-f995eaa1da5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:44.102852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a93e5-5bd9-44b6-a8b0-f995eaa1da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:44.103224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a93e5-5bd9-44b6-a8b0-f995eaa1da5d admin admin] PATH_INFO: `/v3/projects/06a655adb529464d92ed4b2226d1a8ef/users/ebc333f10f9f4db9a9c6ba1e0442bf4f/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:44.143878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a93e5-5bd9-44b6-a8b0-f995eaa1da5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a655adb529464d92ed4b2226d1a8ef, user_id=ebc333f10f9f4db9a9c6ba1e0442bf4f, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:44.146661 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a93e5-5bd9-44b6-a8b0-f995eaa1da5d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:44.182555 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1310/2582] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:44 2022] PUT /identity/v3/projects/06a655adb529464d92ed4b2226d1a8ef/users/ebc333f10f9f4db9a9c6ba1e0442bf4f/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:44.195179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0155-ab60-408b-a5a1-17fc8f4fff14 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:44.195442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0155-ab60-408b-a5a1-17fc8f4fff14 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:44.195747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b0155-ab60-408b-a5a1-17fc8f4fff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:44.247631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7e1b0155-ab60-408b-a5a1-17fc8f4fff14 None None] MFA Rules not processed for user `ebc333f10f9f4db9a9c6ba1e0442bf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:44.249690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7e1b0155-ab60-408b-a5a1-17fc8f4fff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:44.371754 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1273/2583] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:44.376512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a93e5-5bd9-44b6-a8b0-f995eaa1da5d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:44.494490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a93e5-5bd9-44b6-a8b0-f995eaa1da5d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:44.502540 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc8813-a037-41a6-b2f0-9a9c81d0bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:44.503749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc8813-a037-41a6-b2f0-9a9c81d0bd7d admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:44.504132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc8813-a037-41a6-b2f0-9a9c81d0bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:44.504474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc8813-a037-41a6-b2f0-9a9c81d0bd7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:44.505538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc8813-a037-41a6-b2f0-9a9c81d0bd7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:44.509891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc8813-a037-41a6-b2f0-9a9c81d0bd7d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:44.615034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0155-ab60-408b-a5a1-17fc8f4fff14 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:44.616106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1311/2584] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:44 2022] POST /identity/v3/projects => generated 381 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:44.640335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b0155-ab60-408b-a5a1-17fc8f4fff14 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:44.727460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea690568-7439-4201-b160-9e22324496b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:44.728590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea690568-7439-4201-b160-9e22324496b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:44.729016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea690568-7439-4201-b160-9e22324496b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:44.729370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea690568-7439-4201-b160-9e22324496b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:44.730137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea690568-7439-4201-b160-9e22324496b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:44.732564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea690568-7439-4201-b160-9e22324496b2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:44.769885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1274/2585] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:44 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:44.774296 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc8813-a037-41a6-b2f0-9a9c81d0bd7d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:44.798507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc8813-a037-41a6-b2f0-9a9c81d0bd7d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:44.805862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e52ee4-f480-4779-be43-9abab8dd6dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:44.806682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e52ee4-f480-4779-be43-9abab8dd6dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:44.807220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e52ee4-f480-4779-be43-9abab8dd6dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:44.807576 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e52ee4-f480-4779-be43-9abab8dd6dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:44.808941 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e52ee4-f480-4779-be43-9abab8dd6dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:44.812224 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e52ee4-f480-4779-be43-9abab8dd6dd0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:44.824812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1312/2586] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:44.829231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea690568-7439-4201-b160-9e22324496b2 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:44.846498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea690568-7439-4201-b160-9e22324496b2 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:44.851474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95ef26-fabd-4a59-946d-72b6f89ffa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:44.852156 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95ef26-fabd-4a59-946d-72b6f89ffa68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:44.852438 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95ef26-fabd-4a59-946d-72b6f89ffa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:44.853416 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95ef26-fabd-4a59-946d-72b6f89ffa68 admin admin] PATH_INFO: `/v3/projects/94359b380c67494ca3d2bfe9b8e75a3d/users/09d62e3850054fa8910acd00f25d3d4a/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:44.873614 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95ef26-fabd-4a59-946d-72b6f89ffa68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94359b380c67494ca3d2bfe9b8e75a3d, user_id=09d62e3850054fa8910acd00f25d3d4a, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:44.876306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95ef26-fabd-4a59-946d-72b6f89ffa68 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:44.891212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1275/2587] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:44 2022] PUT /identity/v3/projects/94359b380c67494ca3d2bfe9b8e75a3d/users/09d62e3850054fa8910acd00f25d3d4a/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:44.897944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e52ee4-f480-4779-be43-9abab8dd6dd0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:44.915012 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e52ee4-f480-4779-be43-9abab8dd6dd0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:45.007052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69884ffa-1121-4fae-8a5d-d51dd01d51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:45.007756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884ffa-1121-4fae-8a5d-d51dd01d51c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:45.008100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884ffa-1121-4fae-8a5d-d51dd01d51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:45.008424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69884ffa-1121-4fae-8a5d-d51dd01d51c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:45.009161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69884ffa-1121-4fae-8a5d-d51dd01d51c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:45.011074 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69884ffa-1121-4fae-8a5d-d51dd01d51c6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:45.024033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1313/2588] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:45.029659 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95ef26-fabd-4a59-946d-72b6f89ffa68 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:45.040639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95ef26-fabd-4a59-946d-72b6f89ffa68 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:45.046031 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e6c9d-c8db-429b-89e9-1ee479565bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:45.046700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e6c9d-c8db-429b-89e9-1ee479565bab admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:45.047020 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e6c9d-c8db-429b-89e9-1ee479565bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:45.047300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e6c9d-c8db-429b-89e9-1ee479565bab admin admin] PATH_INFO: `/v3/projects/94359b380c67494ca3d2bfe9b8e75a3d/users/09d62e3850054fa8910acd00f25d3d4a/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:45.049362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e6c9d-c8db-429b-89e9-1ee479565bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=94359b380c67494ca3d2bfe9b8e75a3d, user_id=09d62e3850054fa8910acd00f25d3d4a, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:45.052048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e6c9d-c8db-429b-89e9-1ee479565bab admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:45.063911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1276/2589] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:45 2022] PUT /identity/v3/projects/94359b380c67494ca3d2bfe9b8e75a3d/users/09d62e3850054fa8910acd00f25d3d4a/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:45.075665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2d7b5-ceec-473d-baea-6064ea798880 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:45.075960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2d7b5-ceec-473d-baea-6064ea798880 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:45.076241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2d7b5-ceec-473d-baea-6064ea798880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:45.109064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-18b2d7b5-ceec-473d-baea-6064ea798880 None None] MFA Rules not processed for user `09d62e3850054fa8910acd00f25d3d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:45.110593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-18b2d7b5-ceec-473d-baea-6064ea798880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:45.145150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:45.193908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1314/2590] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:45.208081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e6c9d-c8db-429b-89e9-1ee479565bab admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:45.209852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bd1e6c9d-c8db-429b-89e9-1ee479565bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:45.258860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:45.282385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e6c9d-c8db-429b-89e9-1ee479565bab admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:45.286586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aede2-3ab3-4a01-b252-4afe8c00c13d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:45.287232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aede2-3ab3-4a01-b252-4afe8c00c13d service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:45.287516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aede2-3ab3-4a01-b252-4afe8c00c13d service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:45.287796 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aede2-3ab3-4a01-b252-4afe8c00c13d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:45.300422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aede2-3ab3-4a01-b252-4afe8c00c13d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:45.302213 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aede2-3ab3-4a01-b252-4afe8c00c13d service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:45.314442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1277/2591] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:45.772996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2d7b5-ceec-473d-baea-6064ea798880 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:45.783523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2d7b5-ceec-473d-baea-6064ea798880 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:45.788341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3024c12-0f4e-44e5-9356-1006e0a29ae2 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d62e3850054fa8910acd00f25d3d4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94359b380c67494ca3d2bfe9b8e75a3d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:45.788973 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024c12-0f4e-44e5-9356-1006e0a29ae2 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:45.789254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024c12-0f4e-44e5-9356-1006e0a29ae2 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:45.789529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3024c12-0f4e-44e5-9356-1006e0a29ae2 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:45.790202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3024c12-0f4e-44e5-9356-1006e0a29ae2 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:45.790508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3024c12-0f4e-44e5-9356-1006e0a29ae2 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:45.792135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3024c12-0f4e-44e5-9356-1006e0a29ae2 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:45.805483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1315/2592] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:45.809884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aede2-3ab3-4a01-b252-4afe8c00c13d service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:45.819532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aede2-3ab3-4a01-b252-4afe8c00c13d service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:45.824783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31af34-0737-44d8-98e3-610dfc2f07df tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d62e3850054fa8910acd00f25d3d4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94359b380c67494ca3d2bfe9b8e75a3d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:45.825514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31af34-0737-44d8-98e3-610dfc2f07df tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:45.825852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31af34-0737-44d8-98e3-610dfc2f07df tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:45.826303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31af34-0737-44d8-98e3-610dfc2f07df tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:45.827040 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31af34-0737-44d8-98e3-610dfc2f07df tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:45.829139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31af34-0737-44d8-98e3-610dfc2f07df tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:45.860137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1278/2593] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:45 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:45.865204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3024c12-0f4e-44e5-9356-1006e0a29ae2 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:45.879541 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3024c12-0f4e-44e5-9356-1006e0a29ae2 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:45.953950 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d62e3850054fa8910acd00f25d3d4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94359b380c67494ca3d2bfe9b8e75a3d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:45.954671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:45.955039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:45.955327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:45.956091 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:45.956449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:45.958339 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:45.973664 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1316/2594] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:46.022743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31af34-0737-44d8-98e3-610dfc2f07df tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:46.036772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31af34-0737-44d8-98e3-610dfc2f07df tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:46.043713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09d62e3850054fa8910acd00f25d3d4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94359b380c67494ca3d2bfe9b8e75a3d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:46.044573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:46.044970 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:46.045357 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] PATH_INFO: `/v3/projects/869051e22f304ad59a9a10e270f09b2e` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:46.046960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Authorizing `identity:delete_project(project_id=869051e22f304ad59a9a10e270f09b2e)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:46.049542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:46.112866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869051e22f304ad59a9a10e270f09b2e', 'request_id': 'req-338cf6ec-7178-4b0c-b454-8113e9e540f9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.123265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869051e22f304ad59a9a10e270f09b2e', 'request_id': 'req-338cf6ec-7178-4b0c-b454-8113e9e540f9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.130459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869051e22f304ad59a9a10e270f09b2e', 'request_id': 'req-338cf6ec-7178-4b0c-b454-8113e9e540f9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.144224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] The token cache is being invalidate because project 869051e22f304ad59a9a10e270f09b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:46.144520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.145260 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-338cf6ec-7178-4b0c-b454-8113e9e540f9 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.146807 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1279/2595] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:46 2022] DELETE /identity/v3/projects/869051e22f304ad59a9a10e270f09b2e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:46.435320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:46.449306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:46.551413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4dc31-0415-4ab6-8441-2da410ae2b68 tempest-VolumeQuotaClassesTest-1166322393 tempest-VolumeQuotaClassesTest-1166322393-project-admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:46.606723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:46.616725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:46.617368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:46.617646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:46.617915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] PATH_INFO: `/v3/users/ebc333f10f9f4db9a9c6ba1e0442bf4f` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:46.619196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc333f10f9f4db9a9c6ba1e0442bf4f)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:46.621152 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:46.714429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc333f10f9f4db9a9c6ba1e0442bf4f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.736214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc333f10f9f4db9a9c6ba1e0442bf4f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.737181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc333f10f9f4db9a9c6ba1e0442bf4f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.748107 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc333f10f9f4db9a9c6ba1e0442bf4f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.748927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc333f10f9f4db9a9c6ba1e0442bf4f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:46.768327 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1317/2596] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:46 2022] DELETE /identity/v3/users/ebc333f10f9f4db9a9c6ba1e0442bf4f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:46.773387 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e9de7-186c-48ae-bf5d-507fc68fee13 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:46.773676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e9de7-186c-48ae-bf5d-507fc68fee13 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:46.773951 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e9de7-186c-48ae-bf5d-507fc68fee13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:46.807125 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-733e9de7-186c-48ae-bf5d-507fc68fee13 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:46.809679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-733e9de7-186c-48ae-bf5d-507fc68fee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:46.897354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1280/2597] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:46.910320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:46.911964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:47.006116 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80adca-7f68-4ecb-9990-9d24d6dafe34 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:47.010250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fd5f1-1a2c-416c-af29-45433591a8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:47.010990 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd5f1-1a2c-416c-af29-45433591a8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:47.011305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd5f1-1a2c-416c-af29-45433591a8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:47.011685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd5f1-1a2c-416c-af29-45433591a8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:47.023571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fd5f1-1a2c-416c-af29-45433591a8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:47.025226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fd5f1-1a2c-416c-af29-45433591a8f3 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:47.038842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1318/2598] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:47:47.509467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e9de7-186c-48ae-bf5d-507fc68fee13 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:47.513433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-733e9de7-186c-48ae-bf5d-507fc68fee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:47.545514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e9de7-186c-48ae-bf5d-507fc68fee13 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:47.557967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:47.559991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:47.560342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:47.561123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] PATH_INFO: `/v3/projects/06a655adb529464d92ed4b2226d1a8ef` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:47.562373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a655adb529464d92ed4b2226d1a8ef)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:47.565406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:47.626281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:47.634678 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a655adb529464d92ed4b2226d1a8ef', 'request_id': 'req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.649339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a655adb529464d92ed4b2226d1a8ef', 'request_id': 'req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.656657 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a655adb529464d92ed4b2226d1a8ef', 'request_id': 'req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.671415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] The token cache is being invalidate because project 06a655adb529464d92ed4b2226d1a8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:47.671827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.672449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.673981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1281/2599] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:47 2022] DELETE /identity/v3/projects/06a655adb529464d92ed4b2226d1a8ef => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:47.678016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fd5f1-1a2c-416c-af29-45433591a8f3 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:47.689468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fd5f1-1a2c-416c-af29-45433591a8f3 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:47.782913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:47.784073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:47.784622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:47.785350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] PATH_INFO: `/v3/users/09d62e3850054fa8910acd00f25d3d4a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:47.787427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d62e3850054fa8910acd00f25d3d4a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:47.790255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:47.816407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:47.856003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d62e3850054fa8910acd00f25d3d4a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.874428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d62e3850054fa8910acd00f25d3d4a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.875512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d62e3850054fa8910acd00f25d3d4a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.894578 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d62e3850054fa8910acd00f25d3d4a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.895256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-350fbb6f-33cc-43e0-a937-722a58cfa278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d62e3850054fa8910acd00f25d3d4a'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:47.916878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1319/2600] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:47 2022] DELETE /identity/v3/users/09d62e3850054fa8910acd00f25d3d4a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:48.475728 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:48.477804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:48.499628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02293c-e699-4c5c-b1fa-9a6f2e1e2d4c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:48.604868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:48.606077 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:48.606431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:48.606665 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] PATH_INFO: `/v3/projects/94359b380c67494ca3d2bfe9b8e75a3d` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:48.607969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94359b380c67494ca3d2bfe9b8e75a3d)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:48.610016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:48.667736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94359b380c67494ca3d2bfe9b8e75a3d', 'request_id': 'req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:48.677868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94359b380c67494ca3d2bfe9b8e75a3d', 'request_id': 'req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:48.684477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94359b380c67494ca3d2bfe9b8e75a3d', 'request_id': 'req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:48.699897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] The token cache is being invalidate because project 94359b380c67494ca3d2bfe9b8e75a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:48.700364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:48.701209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-31c7cd63-2ece-4da0-a696-168d1f5dc6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:48.703727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1282/2601] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:48 2022] DELETE /identity/v3/projects/94359b380c67494ca3d2bfe9b8e75a3d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:48.708742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd0eff-f217-4b38-ad50-5f480463ce14 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:48.709022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd0eff-f217-4b38-ad50-5f480463ce14 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:48.709396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd0eff-f217-4b38-ad50-5f480463ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:48.733344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2bcd0eff-f217-4b38-ad50-5f480463ce14 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:48.734621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2bcd0eff-f217-4b38-ad50-5f480463ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:48.822707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1320/2602] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:48.831543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2df094-fce5-4cb3-a722-c71d0b21e3af None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:48.832398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2df094-fce5-4cb3-a722-c71d0b21e3af None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:48.832871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2df094-fce5-4cb3-a722-c71d0b21e3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:49.005173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-da2df094-fce5-4cb3-a722-c71d0b21e3af None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:49.006577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-da2df094-fce5-4cb3-a722-c71d0b21e3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:49.021468 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd0eff-f217-4b38-ad50-5f480463ce14 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:49.022349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1283/2603] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:49.033347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd0eff-f217-4b38-ad50-5f480463ce14 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:49.040335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6744-0a92-4005-a487-c04d85b845b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:49.041122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6744-0a92-4005-a487-c04d85b845b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:49.041466 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6744-0a92-4005-a487-c04d85b845b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:49.041811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6744-0a92-4005-a487-c04d85b845b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:49.043196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6744-0a92-4005-a487-c04d85b845b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:49.044361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6744-0a92-4005-a487-c04d85b845b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:49.047710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6744-0a92-4005-a487-c04d85b845b2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:49.064318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1321/2604] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:47:49.069252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2df094-fce5-4cb3-a722-c71d0b21e3af None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:49.082793 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2df094-fce5-4cb3-a722-c71d0b21e3af None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:49.088578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0308a-be87-4628-a9d6-8d2922a36441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:49.090037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0308a-be87-4628-a9d6-8d2922a36441 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:49.091346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0308a-be87-4628-a9d6-8d2922a36441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:49.091346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0308a-be87-4628-a9d6-8d2922a36441 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:49.092041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0308a-be87-4628-a9d6-8d2922a36441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:49.094732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0308a-be87-4628-a9d6-8d2922a36441 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:49.132992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1284/2605] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:49 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:49.138239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6744-0a92-4005-a487-c04d85b845b2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:49.149596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6744-0a92-4005-a487-c04d85b845b2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:49.219696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7296b-4cc4-4890-8a9a-f988cd2b8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:49.221590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7296b-4cc4-4890-8a9a-f988cd2b8caf admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:49.221590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7296b-4cc4-4890-8a9a-f988cd2b8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:49.221590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7296b-4cc4-4890-8a9a-f988cd2b8caf admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:49.221590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7296b-4cc4-4890-8a9a-f988cd2b8caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:49.223488 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7296b-4cc4-4890-8a9a-f988cd2b8caf admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:49.259024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1322/2606] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:49 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:49.263713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0308a-be87-4628-a9d6-8d2922a36441 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:49.276139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0308a-be87-4628-a9d6-8d2922a36441 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:49.282058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff257958-fe7a-4f47-93c7-0fc2959ab878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:49.282682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff257958-fe7a-4f47-93c7-0fc2959ab878 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:49.282985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff257958-fe7a-4f47-93c7-0fc2959ab878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:49.283301 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff257958-fe7a-4f47-93c7-0fc2959ab878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:49.283918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff257958-fe7a-4f47-93c7-0fc2959ab878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:49.285540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff257958-fe7a-4f47-93c7-0fc2959ab878 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:49.304516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1285/2607] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:47:49.306403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7296b-4cc4-4890-8a9a-f988cd2b8caf admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:49.329705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7296b-4cc4-4890-8a9a-f988cd2b8caf admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:49.342767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89849f-bfcd-4c7e-8b92-e5283c7541cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:49.346756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89849f-bfcd-4c7e-8b92-e5283c7541cc admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:49.347360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89849f-bfcd-4c7e-8b92-e5283c7541cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:49.347835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89849f-bfcd-4c7e-8b92-e5283c7541cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:49.348873 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89849f-bfcd-4c7e-8b92-e5283c7541cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:49.351242 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89849f-bfcd-4c7e-8b92-e5283c7541cc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:49.375767 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:49.394339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff257958-fe7a-4f47-93c7-0fc2959ab878 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:49.396682 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1323/2608] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:49.431471 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff257958-fe7a-4f47-93c7-0fc2959ab878 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:49.438417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100543c-1d99-403a-870a-6da7904ec896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:49.439623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100543c-1d99-403a-870a-6da7904ec896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:49.439911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100543c-1d99-403a-870a-6da7904ec896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:49.440191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100543c-1d99-403a-870a-6da7904ec896 admin admin] PATH_INFO: `/v3/projects/a1e41b0ab1cb4b87a4bd62bf0c1d7b16/users/a1ad6db047f24a04b7121c4233742113/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:49.463414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:49.470158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100543c-1d99-403a-870a-6da7904ec896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e41b0ab1cb4b87a4bd62bf0c1d7b16, user_id=a1ad6db047f24a04b7121c4233742113, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:49.475406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100543c-1d99-403a-870a-6da7904ec896 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:49.556216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1286/2609] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:49 2022] PUT /identity/v3/projects/a1e41b0ab1cb4b87a4bd62bf0c1d7b16/users/a1ad6db047f24a04b7121c4233742113/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:47:49.557937 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448136-427f-4f9a-b734-3feda56c0414 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:49.558234 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448136-427f-4f9a-b734-3feda56c0414 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:49.559826 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448136-427f-4f9a-b734-3feda56c0414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:49.611411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-98448136-427f-4f9a-b734-3feda56c0414 None None] MFA Rules not processed for user `a1ad6db047f24a04b7121c4233742113`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:49.613274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-98448136-427f-4f9a-b734-3feda56c0414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:49.783461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1324/2610] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:47:49.791048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100543c-1d99-403a-870a-6da7904ec896 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:49.945561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100543c-1d99-403a-870a-6da7904ec896 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:49.954420 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935141e7-720f-4ff5-8a07-64c58d811dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:49.955415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935141e7-720f-4ff5-8a07-64c58d811dfd admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:49.955996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935141e7-720f-4ff5-8a07-64c58d811dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:49.956549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935141e7-720f-4ff5-8a07-64c58d811dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:49.957759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935141e7-720f-4ff5-8a07-64c58d811dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:49.961927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935141e7-720f-4ff5-8a07-64c58d811dfd admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:50.016975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1287/2611] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:49 2022] POST /identity/v3/projects => generated 401 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:50.018819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448136-427f-4f9a-b734-3feda56c0414 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:50.034405 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448136-427f-4f9a-b734-3feda56c0414 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:50.151924 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25aa2f-34ca-470b-b01d-85519f26b380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:50.154026 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25aa2f-34ca-470b-b01d-85519f26b380 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:50.154784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25aa2f-34ca-470b-b01d-85519f26b380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:50.155298 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25aa2f-34ca-470b-b01d-85519f26b380 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:50.156454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25aa2f-34ca-470b-b01d-85519f26b380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:50.160092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25aa2f-34ca-470b-b01d-85519f26b380 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:50.200659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1325/2612] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:50 2022] POST /identity/v3/users => generated 307 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:50.202579 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935141e7-720f-4ff5-8a07-64c58d811dfd admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:50.224318 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935141e7-720f-4ff5-8a07-64c58d811dfd admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:50.235654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6d0ba-a242-4628-b943-c1b997e3e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:50.236709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6d0ba-a242-4628-b943-c1b997e3e256 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:50.237229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6d0ba-a242-4628-b943-c1b997e3e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:50.238372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6d0ba-a242-4628-b943-c1b997e3e256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:50.239945 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6d0ba-a242-4628-b943-c1b997e3e256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:50.244452 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6d0ba-a242-4628-b943-c1b997e3e256 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:50.277882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1288/2613] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:50.280861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25aa2f-34ca-470b-b01d-85519f26b380 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:50.302028 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25aa2f-34ca-470b-b01d-85519f26b380 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:50.315619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87e4d4-16af-42e4-af41-9d7ddf51ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:50.316955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87e4d4-16af-42e4-af41-9d7ddf51ce22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:50.317509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87e4d4-16af-42e4-af41-9d7ddf51ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:50.318834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87e4d4-16af-42e4-af41-9d7ddf51ce22 admin admin] PATH_INFO: `/v3/projects/6b70c6936d364b9984a2de0474ffe69e/users/4f9d854e2ed240eea03e551336d78892/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:50.352925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6d0ba-a242-4628-b943-c1b997e3e256 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:50.356342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bbe6d0ba-a242-4628-b943-c1b997e3e256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:50.390046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87e4d4-16af-42e4-af41-9d7ddf51ce22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b70c6936d364b9984a2de0474ffe69e, user_id=4f9d854e2ed240eea03e551336d78892, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:50.393393 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87e4d4-16af-42e4-af41-9d7ddf51ce22 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:50.425333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1326/2614] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:50 2022] PUT /identity/v3/projects/6b70c6936d364b9984a2de0474ffe69e/users/4f9d854e2ed240eea03e551336d78892/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:50.430076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87e4d4-16af-42e4-af41-9d7ddf51ce22 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:50.501224 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6d0ba-a242-4628-b943-c1b997e3e256 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:50.559966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:50.566034 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87e4d4-16af-42e4-af41-9d7ddf51ce22 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:50.595274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:50.601764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef400b3-245d-4716-944f-19f5be2eeea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:50.602965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef400b3-245d-4716-944f-19f5be2eeea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:50.603458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef400b3-245d-4716-944f-19f5be2eeea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:50.603805 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bd8a7-437c-4dfc-8cf9-490feeeef863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:50.604433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef400b3-245d-4716-944f-19f5be2eeea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:50.605179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bd8a7-437c-4dfc-8cf9-490feeeef863 service nova] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:50.605548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef400b3-245d-4716-944f-19f5be2eeea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:50.605710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bd8a7-437c-4dfc-8cf9-490feeeef863 service nova] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:50.606481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bd8a7-437c-4dfc-8cf9-490feeeef863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:50.608815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-284bd8a7-437c-4dfc-8cf9-490feeeef863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:50.609129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef400b3-245d-4716-944f-19f5be2eeea2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:50.627871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bd8a7-437c-4dfc-8cf9-490feeeef863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:50.628248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1327/2615] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:50.631981 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bd8a7-437c-4dfc-8cf9-490feeeef863 service nova] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:50.633354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef400b3-245d-4716-944f-19f5be2eeea2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:50.649823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef400b3-245d-4716-944f-19f5be2eeea2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:50.651152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1289/2616] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:50.658852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4882-9cdc-49fc-8ac5-b57478b7874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:50.659685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4882-9cdc-49fc-8ac5-b57478b7874a admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:50.660104 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4882-9cdc-49fc-8ac5-b57478b7874a admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:50.660460 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4882-9cdc-49fc-8ac5-b57478b7874a admin admin] PATH_INFO: `/v3/projects/6b70c6936d364b9984a2de0474ffe69e/users/4f9d854e2ed240eea03e551336d78892/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:50.662787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b4882-9cdc-49fc-8ac5-b57478b7874a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b70c6936d364b9984a2de0474ffe69e, user_id=4f9d854e2ed240eea03e551336d78892, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:50.666003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b4882-9cdc-49fc-8ac5-b57478b7874a admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:50.687004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1328/2617] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:50 2022] PUT /identity/v3/projects/6b70c6936d364b9984a2de0474ffe69e/users/4f9d854e2ed240eea03e551336d78892/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:50.706996 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e378c44-f5f9-48f1-8c10-ed0fd855107a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:50.707526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e378c44-f5f9-48f1-8c10-ed0fd855107a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:50.708032 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e378c44-f5f9-48f1-8c10-ed0fd855107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:50.766914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1e378c44-f5f9-48f1-8c10-ed0fd855107a None None] MFA Rules not processed for user `4f9d854e2ed240eea03e551336d78892`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:50.769367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1e378c44-f5f9-48f1-8c10-ed0fd855107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:50.956668 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1290/2618] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:50.966706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4882-9cdc-49fc-8ac5-b57478b7874a admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:50.970048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cc4b4882-9cdc-49fc-8ac5-b57478b7874a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:51.054874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4882-9cdc-49fc-8ac5-b57478b7874a admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:51.063650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147de3-3bce-44f7-b768-5120e80511f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:51.064659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147de3-3bce-44f7-b768-5120e80511f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:51.064993 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147de3-3bce-44f7-b768-5120e80511f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:51.065292 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147de3-3bce-44f7-b768-5120e80511f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:51.081175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da147de3-3bce-44f7-b768-5120e80511f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:51.083836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da147de3-3bce-44f7-b768-5120e80511f3 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:51.095073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1329/2619] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:50 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:51.238902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e378c44-f5f9-48f1-8c10-ed0fd855107a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:51.240426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1e378c44-f5f9-48f1-8c10-ed0fd855107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:51.255565 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e378c44-f5f9-48f1-8c10-ed0fd855107a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:51.260837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a95621-da80-47f2-9614-0e5513a741c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:51.262072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a95621-da80-47f2-9614-0e5513a741c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:51.262072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a95621-da80-47f2-9614-0e5513a741c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:51.262316 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a95621-da80-47f2-9614-0e5513a741c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:51.348409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a95621-da80-47f2-9614-0e5513a741c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:51.350701 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a95621-da80-47f2-9614-0e5513a741c7 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:51.368837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1291/2620] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:53.869162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147de3-3bce-44f7-b768-5120e80511f3 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:53.871461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-da147de3-3bce-44f7-b768-5120e80511f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:53.958098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147de3-3bce-44f7-b768-5120e80511f3 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:53.965624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d24a00-2750-43e1-8481-0eef4c069d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:53.966644 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24a00-2750-43e1-8481-0eef4c069d91 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:53.967240 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24a00-2750-43e1-8481-0eef4c069d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:53.967633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24a00-2750-43e1-8481-0eef4c069d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:53.970297 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f4d24a00-2750-43e1-8481-0eef4c069d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:54.057815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d24a00-2750-43e1-8481-0eef4c069d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:54.059202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d24a00-2750-43e1-8481-0eef4c069d91 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:54.070887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1330/2621] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:55.816101 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a95621-da80-47f2-9614-0e5513a741c7 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:55.830515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a95621-da80-47f2-9614-0e5513a741c7 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:55.836616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:55.837666 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:55.838136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:55.838409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] PATH_INFO: `/v3/users/a1ad6db047f24a04b7121c4233742113` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:55.840306 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ad6db047f24a04b7121c4233742113)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:55.842727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:55.910808 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ad6db047f24a04b7121c4233742113'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:55.911608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ad6db047f24a04b7121c4233742113'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:55.932481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ad6db047f24a04b7121c4233742113'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:55.935093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:55.943699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ad6db047f24a04b7121c4233742113'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:55.944692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ad6db047f24a04b7121c4233742113'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:55.964396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1292/2622] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:55 2022] DELETE /identity/v3/users/a1ad6db047f24a04b7121c4233742113 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:55.966205 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3c7ff-9b63-4f05-9e59-ac9555dd88a4 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:55.967016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3c7ff-9b63-4f05-9e59-ac9555dd88a4 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:55.967016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3c7ff-9b63-4f05-9e59-ac9555dd88a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:55.988425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5fa3c7ff-9b63-4f05-9e59-ac9555dd88a4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:55.990729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5fa3c7ff-9b63-4f05-9e59-ac9555dd88a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:56.061148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:56.132084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1331/2623] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:56.143426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:56.145532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:56.241376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdcfb9-7602-4318-8a93-5bea4a701d01 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:56.250235 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6bbe3-6f46-4cef-9a41-b6898f166581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:56.251381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6bbe3-6f46-4cef-9a41-b6898f166581 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:56.252825 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6bbe3-6f46-4cef-9a41-b6898f166581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:56.253225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6bbe3-6f46-4cef-9a41-b6898f166581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:56.276727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6bbe3-6f46-4cef-9a41-b6898f166581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:56.280722 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6bbe3-6f46-4cef-9a41-b6898f166581 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:56.305004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1293/2624] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:56.647050 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3c7ff-9b63-4f05-9e59-ac9555dd88a4 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:56.664119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3c7ff-9b63-4f05-9e59-ac9555dd88a4 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:56.672005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b0842-16ab-4fe3-ad6c-52bf9db42270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:56.672652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b0842-16ab-4fe3-ad6c-52bf9db42270 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:56.672938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b0842-16ab-4fe3-ad6c-52bf9db42270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:56.673218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b0842-16ab-4fe3-ad6c-52bf9db42270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:56.676829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c86b0842-16ab-4fe3-ad6c-52bf9db42270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:56.700982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b0842-16ab-4fe3-ad6c-52bf9db42270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:56.703426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b0842-16ab-4fe3-ad6c-52bf9db42270 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:56.719834 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1332/2625] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:47:56.918853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6bbe3-6f46-4cef-9a41-b6898f166581 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:56.921735 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b2f6bbe3-6f46-4cef-9a41-b6898f166581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:56.942582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6bbe3-6f46-4cef-9a41-b6898f166581 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:56.954858 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:56.956080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:56.956586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:56.957227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] PATH_INFO: `/v3/projects/a1e41b0ab1cb4b87a4bd62bf0c1d7b16` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:56.959293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e41b0ab1cb4b87a4bd62bf0c1d7b16)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:56.961654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:57.036308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e41b0ab1cb4b87a4bd62bf0c1d7b16', 'request_id': 'req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.047480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e41b0ab1cb4b87a4bd62bf0c1d7b16', 'request_id': 'req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.054989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e41b0ab1cb4b87a4bd62bf0c1d7b16', 'request_id': 'req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.070477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] The token cache is being invalidate because project a1e41b0ab1cb4b87a4bd62bf0c1d7b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:57.070477 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.071353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.073459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1294/2626] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:56 2022] DELETE /identity/v3/projects/a1e41b0ab1cb4b87a4bd62bf0c1d7b16 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:57.079076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b0842-16ab-4fe3-ad6c-52bf9db42270 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:57.092043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b0842-16ab-4fe3-ad6c-52bf9db42270 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:57.209501 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:57.210587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:57.210877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:57.211228 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] PATH_INFO: `/v3/users/4f9d854e2ed240eea03e551336d78892` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:57.213903 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9d854e2ed240eea03e551336d78892)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:57.217220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:57.320511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9d854e2ed240eea03e551336d78892'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.342355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9d854e2ed240eea03e551336d78892'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.343121 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9d854e2ed240eea03e551336d78892'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.354715 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9d854e2ed240eea03e551336d78892'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.355660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cfeb5041-b553-4e6c-ada5-79ea0a3879ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9d854e2ed240eea03e551336d78892'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:57.392078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1333/2627] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:47:57 2022] DELETE /identity/v3/users/4f9d854e2ed240eea03e551336d78892 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:58.351810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:58.353988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:58.383928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dfc4f-2d59-4ebb-8c9a-864d5b8271ca admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:58.495090 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:58.495797 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:58.496655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:58.496937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] PATH_INFO: `/v3/projects/6b70c6936d364b9984a2de0474ffe69e` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:58.508390 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b70c6936d364b9984a2de0474ffe69e)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:58.513313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:58.526652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:58.636334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b70c6936d364b9984a2de0474ffe69e', 'request_id': 'req-39afdee7-f700-4d5d-b8aa-6bd0c262301b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:58.658002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b70c6936d364b9984a2de0474ffe69e', 'request_id': 'req-39afdee7-f700-4d5d-b8aa-6bd0c262301b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:58.675093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b70c6936d364b9984a2de0474ffe69e', 'request_id': 'req-39afdee7-f700-4d5d-b8aa-6bd0c262301b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:58.690223 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] The token cache is being invalidate because project 6b70c6936d364b9984a2de0474ffe69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:47:58.690829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:58.691734 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-39afdee7-f700-4d5d-b8aa-6bd0c262301b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:47:58.694072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1295/2628] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:47:58 2022] DELETE /identity/v3/projects/6b70c6936d364b9984a2de0474ffe69e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:58.700742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfd53c-fe5e-4318-9ebf-15437061918e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:58.701741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfd53c-fe5e-4318-9ebf-15437061918e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:58.702133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfd53c-fe5e-4318-9ebf-15437061918e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:58.740084 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5fbfd53c-fe5e-4318-9ebf-15437061918e None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:58.742585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5fbfd53c-fe5e-4318-9ebf-15437061918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:58.844813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:58.893982 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1334/2629] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:58.903036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f17d-162e-4ede-965d-b0bac66f5b97 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:58.903485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f17d-162e-4ede-965d-b0bac66f5b97 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:58.904134 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f17d-162e-4ede-965d-b0bac66f5b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:58.976483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-fde2f17d-162e-4ede-965d-b0bac66f5b97 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:58.977876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-fde2f17d-162e-4ede-965d-b0bac66f5b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:58.991948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1296/2630] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:58.993102 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfd53c-fe5e-4318-9ebf-15437061918e None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.012276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfd53c-fe5e-4318-9ebf-15437061918e None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.019751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2daf6-1f00-4584-b2a3-a73255fae3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.021493 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2daf6-1f00-4584-b2a3-a73255fae3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.022435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2daf6-1f00-4584-b2a3-a73255fae3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.023281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2daf6-1f00-4584-b2a3-a73255fae3d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.024552 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2daf6-1f00-4584-b2a3-a73255fae3d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:47:59.025275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2daf6-1f00-4584-b2a3-a73255fae3d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.028787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2daf6-1f00-4584-b2a3-a73255fae3d0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:59.051366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1335/2631] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:47:59.057621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f17d-162e-4ede-965d-b0bac66f5b97 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.070201 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f17d-162e-4ede-965d-b0bac66f5b97 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.077368 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a5f58-bd28-465a-9426-77f4c5614127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.078878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a5f58-bd28-465a-9426-77f4c5614127 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.078878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a5f58-bd28-465a-9426-77f4c5614127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.078878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a5f58-bd28-465a-9426-77f4c5614127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.080530 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a5f58-bd28-465a-9426-77f4c5614127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.082752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a5f58-bd28-465a-9426-77f4c5614127 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:59.127822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1297/2632] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:59 2022] POST /identity/v3/projects => generated 407 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:59.132142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2daf6-1f00-4584-b2a3-a73255fae3d0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.145429 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2daf6-1f00-4584-b2a3-a73255fae3d0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.232259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7388b-1eda-49c1-8995-6fbbdc97369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.232893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7388b-1eda-49c1-8995-6fbbdc97369f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.233177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7388b-1eda-49c1-8995-6fbbdc97369f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.233465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7388b-1eda-49c1-8995-6fbbdc97369f admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.234115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7388b-1eda-49c1-8995-6fbbdc97369f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.236201 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7388b-1eda-49c1-8995-6fbbdc97369f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:59.265371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1336/2633] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:59 2022] POST /identity/v3/users => generated 304 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:47:59.269688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a5f58-bd28-465a-9426-77f4c5614127 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.283545 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a5f58-bd28-465a-9426-77f4c5614127 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.288989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796ef67-f40c-49b0-ab27-cb8840c06e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.289854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ef67-f40c-49b0-ab27-cb8840c06e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.289854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ef67-f40c-49b0-ab27-cb8840c06e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.290455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ef67-f40c-49b0-ab27-cb8840c06e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.290840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796ef67-f40c-49b0-ab27-cb8840c06e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.292582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796ef67-f40c-49b0-ab27-cb8840c06e9c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:59.304693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1298/2634] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:59.309238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7388b-1eda-49c1-8995-6fbbdc97369f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.322255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7388b-1eda-49c1-8995-6fbbdc97369f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.328337 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f5921-6336-4e81-809c-9fa84fe88063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.328986 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f5921-6336-4e81-809c-9fa84fe88063 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.329269 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f5921-6336-4e81-809c-9fa84fe88063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.329550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f5921-6336-4e81-809c-9fa84fe88063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.330216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f5921-6336-4e81-809c-9fa84fe88063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.332245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f5921-6336-4e81-809c-9fa84fe88063 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:59.350928 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1337/2635] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:59.352617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796ef67-f40c-49b0-ab27-cb8840c06e9c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.364419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796ef67-f40c-49b0-ab27-cb8840c06e9c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.370673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40636e5-66f9-4b55-a613-15c1e6e1c863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.371484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40636e5-66f9-4b55-a613-15c1e6e1c863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.372028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40636e5-66f9-4b55-a613-15c1e6e1c863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.372321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40636e5-66f9-4b55-a613-15c1e6e1c863 admin admin] PATH_INFO: `/v3/projects/762b40792aa844a1843b2755ffd342c7/users/5080c88b88de43beb28bda7df466aaa3/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.391135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40636e5-66f9-4b55-a613-15c1e6e1c863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762b40792aa844a1843b2755ffd342c7, user_id=5080c88b88de43beb28bda7df466aaa3, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.394382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40636e5-66f9-4b55-a613-15c1e6e1c863 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:59.410909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1299/2636] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:59 2022] PUT /identity/v3/projects/762b40792aa844a1843b2755ffd342c7/users/5080c88b88de43beb28bda7df466aaa3/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:47:59.423187 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d7991-c772-46a7-b94c-c41fe00a1772 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.423602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d7991-c772-46a7-b94c-c41fe00a1772 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.423972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d7991-c772-46a7-b94c-c41fe00a1772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.471660 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-164d7991-c772-46a7-b94c-c41fe00a1772 None None] MFA Rules not processed for user `5080c88b88de43beb28bda7df466aaa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:47:59.473880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-164d7991-c772-46a7-b94c-c41fe00a1772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:47:59.605581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1338/2637] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:47:59 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:47:59.611211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40636e5-66f9-4b55-a613-15c1e6e1c863 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.708907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40636e5-66f9-4b55-a613-15c1e6e1c863 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.714249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0683cb-0fd7-48f4-9fd3-25bc460d7655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.715136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0683cb-0fd7-48f4-9fd3-25bc460d7655 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.715489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0683cb-0fd7-48f4-9fd3-25bc460d7655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.715772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0683cb-0fd7-48f4-9fd3-25bc460d7655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.716487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0683cb-0fd7-48f4-9fd3-25bc460d7655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.721329 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0683cb-0fd7-48f4-9fd3-25bc460d7655 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:59.754038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1300/2638] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:47:59 2022] POST /identity/v3/projects => generated 409 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:59.758520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d7991-c772-46a7-b94c-c41fe00a1772 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.770511 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d7991-c772-46a7-b94c-c41fe00a1772 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.817805 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:47:59.857586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a200f50-0416-4b0d-b992-d2351b407b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.858320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a200f50-0416-4b0d-b992-d2351b407b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.858748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a200f50-0416-4b0d-b992-d2351b407b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.859075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a200f50-0416-4b0d-b992-d2351b407b02 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.859842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a200f50-0416-4b0d-b992-d2351b407b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.862231 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a200f50-0416-4b0d-b992-d2351b407b02 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:59.893740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1339/2639] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:47:59 2022] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:47:59.895043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0683cb-0fd7-48f4-9fd3-25bc460d7655 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.906744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0683cb-0fd7-48f4-9fd3-25bc460d7655 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.913158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3395-4714-4b90-9e28-85505028a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.913874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3395-4714-4b90-9e28-85505028a00f admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.914287 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3395-4714-4b90-9e28-85505028a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.914564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3395-4714-4b90-9e28-85505028a00f admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.915345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee3395-4714-4b90-9e28-85505028a00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.917381 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee3395-4714-4b90-9e28-85505028a00f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:47:59.931769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1301/2640] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:47:59.937370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a200f50-0416-4b0d-b992-d2351b407b02 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:47:59.954561 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a200f50-0416-4b0d-b992-d2351b407b02 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:47:59.959791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f34601-2ac7-4578-806b-4fc745150807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:47:59.960506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f34601-2ac7-4578-806b-4fc745150807 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:47:59.960892 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f34601-2ac7-4578-806b-4fc745150807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:47:59.961086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f34601-2ac7-4578-806b-4fc745150807 admin admin] PATH_INFO: `/v3/projects/bfd7f2b4c78c402487775c981628fdf0/users/3f8f6849edae44e6924d41be58026c2d/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:47:59.979636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f34601-2ac7-4578-806b-4fc745150807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd7f2b4c78c402487775c981628fdf0, user_id=3f8f6849edae44e6924d41be58026c2d, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:47:59.982880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f34601-2ac7-4578-806b-4fc745150807 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:00.006743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1340/2641] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:47:59 2022] PUT /identity/v3/projects/bfd7f2b4c78c402487775c981628fdf0/users/3f8f6849edae44e6924d41be58026c2d/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:00.011699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3395-4714-4b90-9e28-85505028a00f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:00.027194 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3395-4714-4b90-9e28-85505028a00f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:00.033109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:00.134011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3d96d-7dbf-48b7-ac96-5a94b1bb2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:00.135627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3d96d-7dbf-48b7-ac96-5a94b1bb2066 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:00.135834 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3d96d-7dbf-48b7-ac96-5a94b1bb2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:00.136112 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3d96d-7dbf-48b7-ac96-5a94b1bb2066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:00.136959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3d96d-7dbf-48b7-ac96-5a94b1bb2066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:00.138737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3d96d-7dbf-48b7-ac96-5a94b1bb2066 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:00.153939 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1302/2642] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:00.158259 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f34601-2ac7-4578-806b-4fc745150807 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:00.206001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f34601-2ac7-4578-806b-4fc745150807 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:00.213376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f6366-4924-44a0-9bb1-e621099e9b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:00.214320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f6366-4924-44a0-9bb1-e621099e9b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:00.215740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f6366-4924-44a0-9bb1-e621099e9b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:00.216169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f6366-4924-44a0-9bb1-e621099e9b79 admin admin] PATH_INFO: `/v3/projects/bfd7f2b4c78c402487775c981628fdf0/users/3f8f6849edae44e6924d41be58026c2d/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:00.220293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f6366-4924-44a0-9bb1-e621099e9b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd7f2b4c78c402487775c981628fdf0, user_id=3f8f6849edae44e6924d41be58026c2d, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:00.226053 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f6366-4924-44a0-9bb1-e621099e9b79 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:00.271442 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1341/2643] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:00 2022] PUT /identity/v3/projects/bfd7f2b4c78c402487775c981628fdf0/users/3f8f6849edae44e6924d41be58026c2d/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:00.273562 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cf588-f8d1-4dbb-8364-056fbc71410a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:00.274073 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cf588-f8d1-4dbb-8364-056fbc71410a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:00.274334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cf588-f8d1-4dbb-8364-056fbc71410a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:00.314405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c79cf588-f8d1-4dbb-8364-056fbc71410a None None] MFA Rules not processed for user `3f8f6849edae44e6924d41be58026c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:00.318067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c79cf588-f8d1-4dbb-8364-056fbc71410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:00.434397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1303/2644] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:00 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:00.442344 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f6366-4924-44a0-9bb1-e621099e9b79 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:00.444710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f11f6366-4924-44a0-9bb1-e621099e9b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:00.532546 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f6366-4924-44a0-9bb1-e621099e9b79 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:00.541098 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f454a-05c9-4a0d-8e84-555cc0c32abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:00.542884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f454a-05c9-4a0d-8e84-555cc0c32abe service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:00.543502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f454a-05c9-4a0d-8e84-555cc0c32abe service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:00.544088 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f454a-05c9-4a0d-8e84-555cc0c32abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:00.564502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f454a-05c9-4a0d-8e84-555cc0c32abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:00.566969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f454a-05c9-4a0d-8e84-555cc0c32abe service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:00.602189 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1342/2645] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:00 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:00.860016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cf588-f8d1-4dbb-8364-056fbc71410a None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:00.892295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cf588-f8d1-4dbb-8364-056fbc71410a None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:00.902441 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7defb-53e2-4e1d-8095-bb3cb0c0ef42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:00.903084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7defb-53e2-4e1d-8095-bb3cb0c0ef42 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:00.903376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7defb-53e2-4e1d-8095-bb3cb0c0ef42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:00.903642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7defb-53e2-4e1d-8095-bb3cb0c0ef42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:01.001226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7defb-53e2-4e1d-8095-bb3cb0c0ef42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:01.002838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7defb-53e2-4e1d-8095-bb3cb0c0ef42 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:01.014769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1304/2646] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:00 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:48:03.081998 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f454a-05c9-4a0d-8e84-555cc0c32abe service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:03.085233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-956f454a-05c9-4a0d-8e84-555cc0c32abe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:03.215917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:03.272311 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f454a-05c9-4a0d-8e84-555cc0c32abe service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:03.279306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:03.280992 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:03.281271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:03.281550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] PATH_INFO: `/v3/users/f865fb654778404a846ec2465eeef8e2` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:03.282809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f865fb654778404a846ec2465eeef8e2)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:03.284868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:03.387984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f865fb654778404a846ec2465eeef8e2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:03.410594 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f865fb654778404a846ec2465eeef8e2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:03.411454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f865fb654778404a846ec2465eeef8e2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:03.426616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f865fb654778404a846ec2465eeef8e2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:03.429720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f865fb654778404a846ec2465eeef8e2'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:03.459218 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1343/2647] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:03 2022] DELETE /identity/v3/users/f865fb654778404a846ec2465eeef8e2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:03.473429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab98fb7-f70e-4ec3-a0e8-c581a4e9f440 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:03.474619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab98fb7-f70e-4ec3-a0e8-c581a4e9f440 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:03.475311 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab98fb7-f70e-4ec3-a0e8-c581a4e9f440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:03.500237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-dab98fb7-f70e-4ec3-a0e8-c581a4e9f440 None None] MFA Rules not processed for user `c01f2e5585ba41e8b3947177030a4759`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:03.501864 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-dab98fb7-f70e-4ec3-a0e8-c581a4e9f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:03.530075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:03.575204 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1305/2648] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:03.875887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:03.880150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:04.138820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439abc03-1aee-4adf-953e-6e7208cf8372 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:04.169154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:04.171128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:04.178665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:04.179617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] PATH_INFO: `/v3/projects/07b81ab3fe6c4728bcbb84fdb11eaea6` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:04.200326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b81ab3fe6c4728bcbb84fdb11eaea6)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:04.206286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:04.357602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:04.361062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b81ab3fe6c4728bcbb84fdb11eaea6', 'request_id': 'req-369ade96-948c-479a-b9d5-2e9492331f58'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:04.378390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b81ab3fe6c4728bcbb84fdb11eaea6', 'request_id': 'req-369ade96-948c-479a-b9d5-2e9492331f58'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:04.393022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b81ab3fe6c4728bcbb84fdb11eaea6', 'request_id': 'req-369ade96-948c-479a-b9d5-2e9492331f58'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:04.410284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] The token cache is being invalidate because project 07b81ab3fe6c4728bcbb84fdb11eaea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:04.410784 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:04.411906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-369ade96-948c-479a-b9d5-2e9492331f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:04.418707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1344/2649] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:03 2022] DELETE /identity/v3/projects/07b81ab3fe6c4728bcbb84fdb11eaea6 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:04.420750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8afc5-c29d-4ecf-b118-352409608923 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:04.421258 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8afc5-c29d-4ecf-b118-352409608923 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:04.421572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8afc5-c29d-4ecf-b118-352409608923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:04.524632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-58d8afc5-c29d-4ecf-b118-352409608923 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:04.526992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-58d8afc5-c29d-4ecf-b118-352409608923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:04.611247 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1306/2650] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:04.619915 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c2a63-cacc-4954-a499-6de954159e5b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:04.620278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c2a63-cacc-4954-a499-6de954159e5b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:04.620487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c2a63-cacc-4954-a499-6de954159e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:04.648598 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-934c2a63-cacc-4954-a499-6de954159e5b None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:04.649792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-934c2a63-cacc-4954-a499-6de954159e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:04.663749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1345/2651] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:04.665515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8afc5-c29d-4ecf-b118-352409608923 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:04.678516 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8afc5-c29d-4ecf-b118-352409608923 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:04.684081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35717-4bb7-4e6d-9c4f-e76f7b195ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:04.684798 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35717-4bb7-4e6d-9c4f-e76f7b195ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:04.685142 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35717-4bb7-4e6d-9c4f-e76f7b195ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:04.685486 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35717-4bb7-4e6d-9c4f-e76f7b195ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:04.686265 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b35717-4bb7-4e6d-9c4f-e76f7b195ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:48:04.686631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b35717-4bb7-4e6d-9c4f-e76f7b195ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:04.688560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b35717-4bb7-4e6d-9c4f-e76f7b195ddb admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:04.717033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1307/2652] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:48:04.721771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c2a63-cacc-4954-a499-6de954159e5b None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:04.762461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c2a63-cacc-4954-a499-6de954159e5b None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:04.768584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25256c1-9a0d-4429-9504-98563871a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:04.769443 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25256c1-9a0d-4429-9504-98563871a7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:04.769827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25256c1-9a0d-4429-9504-98563871a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:04.770247 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25256c1-9a0d-4429-9504-98563871a7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:04.771047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25256c1-9a0d-4429-9504-98563871a7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:04.773432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25256c1-9a0d-4429-9504-98563871a7f5 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:04.825121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35717-4bb7-4e6d-9c4f-e76f7b195ddb admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:04.831148 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1346/2653] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:04 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:04.838791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35717-4bb7-4e6d-9c4f-e76f7b195ddb admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:04.937429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1efb4c-28c1-4c77-a36e-3fe38438f2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:04.938227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1efb4c-28c1-4c77-a36e-3fe38438f2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:04.938662 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1efb4c-28c1-4c77-a36e-3fe38438f2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:04.938778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1efb4c-28c1-4c77-a36e-3fe38438f2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:04.942920 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1efb4c-28c1-4c77-a36e-3fe38438f2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:04.946175 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1efb4c-28c1-4c77-a36e-3fe38438f2c2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:04.981629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25256c1-9a0d-4429-9504-98563871a7f5 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:04.989342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1308/2654] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:04 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:04.994427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25256c1-9a0d-4429-9504-98563871a7f5 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:05.002171 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e733e2-6e8a-4ba5-8bc0-5f106633e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:05.003119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e733e2-6e8a-4ba5-8bc0-5f106633e83b admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:05.003545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e733e2-6e8a-4ba5-8bc0-5f106633e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:05.003883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e733e2-6e8a-4ba5-8bc0-5f106633e83b admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:05.004738 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e733e2-6e8a-4ba5-8bc0-5f106633e83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:05.006457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e733e2-6e8a-4ba5-8bc0-5f106633e83b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:05.026860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1347/2655] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:05.028952 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1efb4c-28c1-4c77-a36e-3fe38438f2c2 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:05.043876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1efb4c-28c1-4c77-a36e-3fe38438f2c2 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:05.054775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bec12-ca8f-488b-879a-f507943aa89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:05.058017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bec12-ca8f-488b-879a-f507943aa89f admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:05.059151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bec12-ca8f-488b-879a-f507943aa89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:05.059919 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bec12-ca8f-488b-879a-f507943aa89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:05.061396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bec12-ca8f-488b-879a-f507943aa89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:05.063476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bec12-ca8f-488b-879a-f507943aa89f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:05.079239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1309/2656] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:05.083645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e733e2-6e8a-4ba5-8bc0-5f106633e83b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:05.097754 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e733e2-6e8a-4ba5-8bc0-5f106633e83b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:05.104564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299895de-25ce-4ba0-9fbd-65b8449f3a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:05.105947 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299895de-25ce-4ba0-9fbd-65b8449f3a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:05.106232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299895de-25ce-4ba0-9fbd-65b8449f3a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:05.106510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299895de-25ce-4ba0-9fbd-65b8449f3a71 admin admin] PATH_INFO: `/v3/projects/56563ac51e02430191e9196b97f77034/users/4a31911f673740fb8ea42e4bbf28f021/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:05.155234 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299895de-25ce-4ba0-9fbd-65b8449f3a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56563ac51e02430191e9196b97f77034, user_id=4a31911f673740fb8ea42e4bbf28f021, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:05.163473 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299895de-25ce-4ba0-9fbd-65b8449f3a71 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:05.189285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1348/2657] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:05 2022] PUT /identity/v3/projects/56563ac51e02430191e9196b97f77034/users/4a31911f673740fb8ea42e4bbf28f021/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:05.199719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3586-ce67-4a26-808b-543a3c29c218 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:05.200000 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3586-ce67-4a26-808b-543a3c29c218 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:05.200449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d3586-ce67-4a26-808b-543a3c29c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:05.250531 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:05.266520 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-769d3586-ce67-4a26-808b-543a3c29c218 None None] MFA Rules not processed for user `4a31911f673740fb8ea42e4bbf28f021`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:05.268498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-769d3586-ce67-4a26-808b-543a3c29c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:05.433410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1310/2658] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:05.444449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299895de-25ce-4ba0-9fbd-65b8449f3a71 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:05.446671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-299895de-25ce-4ba0-9fbd-65b8449f3a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:05.718007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299895de-25ce-4ba0-9fbd-65b8449f3a71 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:05.726827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df589d1c-abf6-4a30-ae7c-2c2eed96882f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cbda75c38b04e6c89f17e655eb4f737', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:05.727586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df589d1c-abf6-4a30-ae7c-2c2eed96882f service nova] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:05.727856 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df589d1c-abf6-4a30-ae7c-2c2eed96882f service nova] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:05.728134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df589d1c-abf6-4a30-ae7c-2c2eed96882f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:05.738022 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df589d1c-abf6-4a30-ae7c-2c2eed96882f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:05.740673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df589d1c-abf6-4a30-ae7c-2c2eed96882f service nova] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:05.751711 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1349/2659] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:06.050157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3586-ce67-4a26-808b-543a3c29c218 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:06.052111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-769d3586-ce67-4a26-808b-543a3c29c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:06.182323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d3586-ce67-4a26-808b-543a3c29c218 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:06.194804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:06.196822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:06.197124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:06.197448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] PATH_INFO: `/v3/users/3226b4c9f79c48ff9574c2af20a41a73` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:06.199036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3226b4c9f79c48ff9574c2af20a41a73)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:06.202474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:06.342809 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3226b4c9f79c48ff9574c2af20a41a73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.343729 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3226b4c9f79c48ff9574c2af20a41a73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.404628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3226b4c9f79c48ff9574c2af20a41a73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.435261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3226b4c9f79c48ff9574c2af20a41a73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.435933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3226b4c9f79c48ff9574c2af20a41a73'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.459916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1311/2660] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:06 2022] DELETE /identity/v3/users/3226b4c9f79c48ff9574c2af20a41a73 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:06.764951 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df589d1c-abf6-4a30-ae7c-2c2eed96882f service nova] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:06.791157 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df589d1c-abf6-4a30-ae7c-2c2eed96882f service nova] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:06.810095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:06.872270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:06.872827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:06.873168 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:06.873436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] PATH_INFO: `/v3/projects/023ff0ca5a0b4cf9b90a557e2b11cdcf` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:06.874812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=023ff0ca5a0b4cf9b90a557e2b11cdcf)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:06.877032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:06.933210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023ff0ca5a0b4cf9b90a557e2b11cdcf', 'request_id': 'req-0f860912-9b2b-4502-a4c8-639c2785a4cd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.941602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023ff0ca5a0b4cf9b90a557e2b11cdcf', 'request_id': 'req-0f860912-9b2b-4502-a4c8-639c2785a4cd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.950881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023ff0ca5a0b4cf9b90a557e2b11cdcf', 'request_id': 'req-0f860912-9b2b-4502-a4c8-639c2785a4cd'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.966273 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] The token cache is being invalidate because project 023ff0ca5a0b4cf9b90a557e2b11cdcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:06.966633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.967894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:06.968887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1350/2661] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:06 2022] DELETE /identity/v3/projects/023ff0ca5a0b4cf9b90a557e2b11cdcf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:06.973537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:06.975608 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:06.997006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fdf82-63ac-4b3f-bbff-1f81b1a962d0 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:07.011641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:07.086616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:07.087598 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:07.087694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:07.088851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] PATH_INFO: `/v3/users/e1fef50560dc4be8a3fc95129e4a2c41` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:07.090174 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1fef50560dc4be8a3fc95129e4a2c41)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:07.092959 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:07.167518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1fef50560dc4be8a3fc95129e4a2c41'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.168888 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1fef50560dc4be8a3fc95129e4a2c41'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.188335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1fef50560dc4be8a3fc95129e4a2c41'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.200631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:07.205298 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:07.212837 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1fef50560dc4be8a3fc95129e4a2c41'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.214299 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5611b66-a130-483c-a16c-a48eb7f84d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1fef50560dc4be8a3fc95129e4a2c41'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.232417 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f860912-9b2b-4502-a4c8-639c2785a4cd admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:07.240126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1312/2662] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:06 2022] DELETE /identity/v3/users/e1fef50560dc4be8a3fc95129e4a2c41 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:07.240423 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:07.242368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:07.248570 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:07.249421 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] PATH_INFO: `/v3/users/5080c88b88de43beb28bda7df466aaa3` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:07.251267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5080c88b88de43beb28bda7df466aaa3)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:07.253035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:07.319214 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5080c88b88de43beb28bda7df466aaa3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.336483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5080c88b88de43beb28bda7df466aaa3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.337286 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5080c88b88de43beb28bda7df466aaa3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.347966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5080c88b88de43beb28bda7df466aaa3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.348936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5080c88b88de43beb28bda7df466aaa3'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.363284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1351/2663] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:07 2022] DELETE /identity/v3/users/5080c88b88de43beb28bda7df466aaa3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:07.367891 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce542ac-9f51-4fd6-963e-16e5ec630e42 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:07.368184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce542ac-9f51-4fd6-963e-16e5ec630e42 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:07.368463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce542ac-9f51-4fd6-963e-16e5ec630e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:07.393008 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-fce542ac-9f51-4fd6-963e-16e5ec630e42 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:07.396259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-fce542ac-9f51-4fd6-963e-16e5ec630e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:07.512747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1313/2664] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:07.534113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:07.535776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:07.547065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce542ac-9f51-4fd6-963e-16e5ec630e42 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:07.551363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-fce542ac-9f51-4fd6-963e-16e5ec630e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:07.565586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce542ac-9f51-4fd6-963e-16e5ec630e42 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:07.572838 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:07.573494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:07.573770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:07.574682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] PATH_INFO: `/v3/projects/92c5f4e18e97474994c343d501352716` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:07.576208 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c5f4e18e97474994c343d501352716)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:07.579239 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:07.583827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:07.643022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:07.647019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edc570-87cc-4cc5-9259-8dfb0345614f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:07.667944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c5f4e18e97474994c343d501352716', 'request_id': 'req-88c843da-881c-489d-92ee-b1f2b74436c9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.682355 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c5f4e18e97474994c343d501352716', 'request_id': 'req-88c843da-881c-489d-92ee-b1f2b74436c9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.691828 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c5f4e18e97474994c343d501352716', 'request_id': 'req-88c843da-881c-489d-92ee-b1f2b74436c9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.710384 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] The token cache is being invalidate because project 92c5f4e18e97474994c343d501352716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:07.710813 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.713052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:07.717164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1314/2665] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:07 2022] DELETE /identity/v3/projects/92c5f4e18e97474994c343d501352716 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:07.726294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ad98-20c5-4a77-ac7f-6704a29c37d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:07.727180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ad98-20c5-4a77-ac7f-6704a29c37d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:07.727615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ad98-20c5-4a77-ac7f-6704a29c37d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:07.728100 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7ad98-20c5-4a77-ac7f-6704a29c37d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:07.732863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f1f7ad98-20c5-4a77-ac7f-6704a29c37d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:07.839491 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ad98-20c5-4a77-ac7f-6704a29c37d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:07.842994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7ad98-20c5-4a77-ac7f-6704a29c37d4 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:07.858481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1352/2666] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:08.485715 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:08.487641 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:08.506460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c843da-881c-489d-92ee-b1f2b74436c9 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:08.515359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:08.516450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:08.516813 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:08.517190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] PATH_INFO: `/v3/projects/762b40792aa844a1843b2755ffd342c7` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:08.518851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=762b40792aa844a1843b2755ffd342c7)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:08.521087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:08.600295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762b40792aa844a1843b2755ffd342c7', 'request_id': 'req-164bdf81-871a-43b3-84f3-05e6f49c4fa2'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.616595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762b40792aa844a1843b2755ffd342c7', 'request_id': 'req-164bdf81-871a-43b3-84f3-05e6f49c4fa2'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.626972 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762b40792aa844a1843b2755ffd342c7', 'request_id': 'req-164bdf81-871a-43b3-84f3-05e6f49c4fa2'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.651136 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] The token cache is being invalidate because project 762b40792aa844a1843b2755ffd342c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:08.651360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.652084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.655896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1315/2667] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:08 2022] DELETE /identity/v3/projects/762b40792aa844a1843b2755ffd342c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:08.660300 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ad98-20c5-4a77-ac7f-6704a29c37d4 service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:08.676170 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7ad98-20c5-4a77-ac7f-6704a29c37d4 service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:08.769411 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:08.770470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:08.770954 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:08.771572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] PATH_INFO: `/v3/users/3f8f6849edae44e6924d41be58026c2d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:08.773655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8f6849edae44e6924d41be58026c2d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:08.776699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:08.812331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:08.814731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:08.823221 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:08.847867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8f6849edae44e6924d41be58026c2d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.864335 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8f6849edae44e6924d41be58026c2d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.865561 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8f6849edae44e6924d41be58026c2d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.877553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8f6849edae44e6924d41be58026c2d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.878515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8f6849edae44e6924d41be58026c2d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:08.896302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1353/2668] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:08 2022] DELETE /identity/v3/users/3f8f6849edae44e6924d41be58026c2d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:08.906862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bdf81-871a-43b3-84f3-05e6f49c4fa2 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:09.002842 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59855c8-59b2-4298-9d91-3a40b0608aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:09.005409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59855c8-59b2-4298-9d91-3a40b0608aca service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:09.006405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59855c8-59b2-4298-9d91-3a40b0608aca service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:09.006405 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59855c8-59b2-4298-9d91-3a40b0608aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:09.012589 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a59855c8-59b2-4298-9d91-3a40b0608aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:09.044491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:09.114352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59855c8-59b2-4298-9d91-3a40b0608aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:09.115827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59855c8-59b2-4298-9d91-3a40b0608aca service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:09.126273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1316/2669] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:09.513310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:09.515854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:09.632663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6d34-09c5-4208-879c-c478abb45730 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:09.639018 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:09.639698 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:09.639977 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:09.640267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] PATH_INFO: `/v3/projects/bfd7f2b4c78c402487775c981628fdf0` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:09.641524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd7f2b4c78c402487775c981628fdf0)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:09.643637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:09.709683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd7f2b4c78c402487775c981628fdf0', 'request_id': 'req-4600aed6-2325-4a8b-8b6b-9df3af784272'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:09.718642 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd7f2b4c78c402487775c981628fdf0', 'request_id': 'req-4600aed6-2325-4a8b-8b6b-9df3af784272'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:09.731387 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd7f2b4c78c402487775c981628fdf0', 'request_id': 'req-4600aed6-2325-4a8b-8b6b-9df3af784272'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:09.753460 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] The token cache is being invalidate because project bfd7f2b4c78c402487775c981628fdf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:09.753801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:09.754615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-4600aed6-2325-4a8b-8b6b-9df3af784272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:09.761400 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1354/2670] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:09 2022] DELETE /identity/v3/projects/bfd7f2b4c78c402487775c981628fdf0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:09.764010 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fc8f7-a236-47f4-bec1-fabc3d823522 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:09.764633 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fc8f7-a236-47f4-bec1-fabc3d823522 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:09.764743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fc8f7-a236-47f4-bec1-fabc3d823522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:09.793655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-2e2fc8f7-a236-47f4-bec1-fabc3d823522 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:09.795043 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2e2fc8f7-a236-47f4-bec1-fabc3d823522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:09.927587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1317/2671] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:09.931376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82ed3d-31b2-4c8d-822b-17b006d73e5f None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:09.931843 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82ed3d-31b2-4c8d-822b-17b006d73e5f None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:09.932587 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82ed3d-31b2-4c8d-822b-17b006d73e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:09.967161 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-6f82ed3d-31b2-4c8d-822b-17b006d73e5f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:09.969195 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-6f82ed3d-31b2-4c8d-822b-17b006d73e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:09.981075 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1355/2672] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:09.988250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fc8f7-a236-47f4-bec1-fabc3d823522 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:10.005818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fc8f7-a236-47f4-bec1-fabc3d823522 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:10.012504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe7a4f-dc63-4e7e-aa84-14f474b44635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:10.013487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7a4f-dc63-4e7e-aa84-14f474b44635 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:10.013847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7a4f-dc63-4e7e-aa84-14f474b44635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:10.014276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7a4f-dc63-4e7e-aa84-14f474b44635 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:10.015022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe7a4f-dc63-4e7e-aa84-14f474b44635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:48:10.015376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe7a4f-dc63-4e7e-aa84-14f474b44635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:10.017288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe7a4f-dc63-4e7e-aa84-14f474b44635 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:10.033499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1318/2673] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:48:10.038464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82ed3d-31b2-4c8d-822b-17b006d73e5f None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:10.049553 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82ed3d-31b2-4c8d-822b-17b006d73e5f None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:10.055936 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b98dc-44ad-467b-982a-1f61012dfbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:10.056593 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b98dc-44ad-467b-982a-1f61012dfbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:10.056887 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b98dc-44ad-467b-982a-1f61012dfbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:10.057165 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b98dc-44ad-467b-982a-1f61012dfbf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:10.057801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b98dc-44ad-467b-982a-1f61012dfbf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:10.061364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b98dc-44ad-467b-982a-1f61012dfbf0 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:10.097677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1356/2674] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:10 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:10.102629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe7a4f-dc63-4e7e-aa84-14f474b44635 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:10.114091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe7a4f-dc63-4e7e-aa84-14f474b44635 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:10.221569 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152cf62-686a-452a-81f0-72b761077c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:10.222493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152cf62-686a-452a-81f0-72b761077c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:10.222960 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152cf62-686a-452a-81f0-72b761077c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:10.223434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152cf62-686a-452a-81f0-72b761077c4b admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:10.224555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152cf62-686a-452a-81f0-72b761077c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:10.228425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152cf62-686a-452a-81f0-72b761077c4b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:10.264028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1319/2675] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:10 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:10.269255 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b98dc-44ad-467b-982a-1f61012dfbf0 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:10.276970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:10.282673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b98dc-44ad-467b-982a-1f61012dfbf0 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:10.290885 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0dab-1e3b-447a-ac11-5a001d171f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:10.291707 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0dab-1e3b-447a-ac11-5a001d171f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:10.292248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0dab-1e3b-447a-ac11-5a001d171f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:10.292719 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d0dab-1e3b-447a-ac11-5a001d171f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:10.295318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0dab-1e3b-447a-ac11-5a001d171f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:10.297216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d0dab-1e3b-447a-ac11-5a001d171f35 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:10.310112 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1357/2676] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:10.314442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152cf62-686a-452a-81f0-72b761077c4b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:10.325644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152cf62-686a-452a-81f0-72b761077c4b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:10.330763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296d7f1-57f7-4392-a4f1-d9a12255c72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:10.331454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d7f1-57f7-4392-a4f1-d9a12255c72f admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:10.331736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d7f1-57f7-4392-a4f1-d9a12255c72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:10.332016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d7f1-57f7-4392-a4f1-d9a12255c72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:10.332692 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296d7f1-57f7-4392-a4f1-d9a12255c72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:10.334396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296d7f1-57f7-4392-a4f1-d9a12255c72f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:10.347336 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1320/2677] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:10.362766 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0dab-1e3b-447a-ac11-5a001d171f35 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:10.385415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d0dab-1e3b-447a-ac11-5a001d171f35 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:10.391673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4b179-a23a-4531-a2c5-30fed7f11b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:10.392509 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4b179-a23a-4531-a2c5-30fed7f11b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:10.392786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4b179-a23a-4531-a2c5-30fed7f11b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:10.393062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4b179-a23a-4531-a2c5-30fed7f11b5b admin admin] PATH_INFO: `/v3/projects/86cb0aa1244a4c71b1d83ac98fa77bcd/users/47d74020251d4299b2ca135a198b9a20/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:10.413838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4b179-a23a-4531-a2c5-30fed7f11b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86cb0aa1244a4c71b1d83ac98fa77bcd, user_id=47d74020251d4299b2ca135a198b9a20, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:10.418605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4b179-a23a-4531-a2c5-30fed7f11b5b admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:10.436550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1358/2678] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:10 2022] PUT /identity/v3/projects/86cb0aa1244a4c71b1d83ac98fa77bcd/users/47d74020251d4299b2ca135a198b9a20/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:10.449940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea227d-2472-41dd-b113-72040d28e6c3 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:10.450605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea227d-2472-41dd-b113-72040d28e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:10.454153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea227d-2472-41dd-b113-72040d28e6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:10.526439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b7ea227d-2472-41dd-b113-72040d28e6c3 None None] MFA Rules not processed for user `47d74020251d4299b2ca135a198b9a20`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:10.533992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b7ea227d-2472-41dd-b113-72040d28e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:10.540293 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:10.681706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1321/2679] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:10.686312 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4b179-a23a-4531-a2c5-30fed7f11b5b admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:10.770811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4b179-a23a-4531-a2c5-30fed7f11b5b admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:10.775916 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c0a03-735f-4e28-8634-8c0d6c1575c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:10.779033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c0a03-735f-4e28-8634-8c0d6c1575c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:10.779797 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c0a03-735f-4e28-8634-8c0d6c1575c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:10.780232 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c0a03-735f-4e28-8634-8c0d6c1575c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:10.781016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c0a03-735f-4e28-8634-8c0d6c1575c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:10.783636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c0a03-735f-4e28-8634-8c0d6c1575c8 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:10.818777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1359/2680] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:10 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:10.825818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea227d-2472-41dd-b113-72040d28e6c3 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:10.839531 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea227d-2472-41dd-b113-72040d28e6c3 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:10.925841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad6122-f9e3-460c-939d-999c20eca079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:10.926663 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad6122-f9e3-460c-939d-999c20eca079 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:10.927060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad6122-f9e3-460c-939d-999c20eca079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:10.927639 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad6122-f9e3-460c-939d-999c20eca079 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:10.929075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad6122-f9e3-460c-939d-999c20eca079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:10.932948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad6122-f9e3-460c-939d-999c20eca079 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:10.975865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1322/2681] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:10 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:10.976554 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c0a03-735f-4e28-8634-8c0d6c1575c8 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:11.002839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c0a03-735f-4e28-8634-8c0d6c1575c8 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:11.011456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ca969-a649-4ba0-850f-0ec04bda61e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:11.012618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ca969-a649-4ba0-850f-0ec04bda61e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.013133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ca969-a649-4ba0-850f-0ec04bda61e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.013639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ca969-a649-4ba0-850f-0ec04bda61e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.014874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ca969-a649-4ba0-850f-0ec04bda61e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:11.018748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ca969-a649-4ba0-850f-0ec04bda61e6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:11.041478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1360/2682] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:48:11.044190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad6122-f9e3-460c-939d-999c20eca079 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:11.065547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad6122-f9e3-460c-939d-999c20eca079 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:11.075145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8788cc2-fc4c-498e-a501-811cb38e08e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:11.076209 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8788cc2-fc4c-498e-a501-811cb38e08e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.076764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8788cc2-fc4c-498e-a501-811cb38e08e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.077307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8788cc2-fc4c-498e-a501-811cb38e08e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.078530 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8788cc2-fc4c-498e-a501-811cb38e08e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:11.081504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8788cc2-fc4c-498e-a501-811cb38e08e9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:11.108732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1323/2683] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:11.109921 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ca969-a649-4ba0-850f-0ec04bda61e6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:11.128317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ca969-a649-4ba0-850f-0ec04bda61e6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:11.138426 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb19398-4258-4d91-8bb4-3a737c67e3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:11.138961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb19398-4258-4d91-8bb4-3a737c67e3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.139467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb19398-4258-4d91-8bb4-3a737c67e3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.139958 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb19398-4258-4d91-8bb4-3a737c67e3d9 admin admin] PATH_INFO: `/v3/projects/1ffbbfac60d847348c234d507e8cbdde/users/2033c5f93674452f95ace12e11795274/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.184396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb19398-4258-4d91-8bb4-3a737c67e3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffbbfac60d847348c234d507e8cbdde, user_id=2033c5f93674452f95ace12e11795274, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:11.190800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb19398-4258-4d91-8bb4-3a737c67e3d9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:11.218829 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1361/2684] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:11 2022] PUT /identity/v3/projects/1ffbbfac60d847348c234d507e8cbdde/users/2033c5f93674452f95ace12e11795274/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:11.229688 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11a122-968d-4393-9aea-a82b96959dd7 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.230276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11a122-968d-4393-9aea-a82b96959dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.231542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11a122-968d-4393-9aea-a82b96959dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.265921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-dc11a122-968d-4393-9aea-a82b96959dd7 None None] MFA Rules not processed for user `2033c5f93674452f95ace12e11795274`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:11.267295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-dc11a122-968d-4393-9aea-a82b96959dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:11.360386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1324/2685] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:11.365482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb19398-4258-4d91-8bb4-3a737c67e3d9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:11.439913 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb19398-4258-4d91-8bb4-3a737c67e3d9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:11.446086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bbaca-bb52-4229-9b36-f16b98c654e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:11.446804 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bbaca-bb52-4229-9b36-f16b98c654e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.447032 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bbaca-bb52-4229-9b36-f16b98c654e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.447299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bbaca-bb52-4229-9b36-f16b98c654e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.448047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bbaca-bb52-4229-9b36-f16b98c654e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:11.450694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bbaca-bb52-4229-9b36-f16b98c654e7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:11.494878 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1362/2686] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:11 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:11.499763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11a122-968d-4393-9aea-a82b96959dd7 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:11.511231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11a122-968d-4393-9aea-a82b96959dd7 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:11.525389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:11.585002 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a051-5f59-4f31-92c7-fd704677412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:11.585738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a051-5f59-4f31-92c7-fd704677412d admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.586022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a051-5f59-4f31-92c7-fd704677412d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.586393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a051-5f59-4f31-92c7-fd704677412d admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.587154 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13a051-5f59-4f31-92c7-fd704677412d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:11.589536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13a051-5f59-4f31-92c7-fd704677412d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:11.614144 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1325/2687] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:11 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:11.618362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bbaca-bb52-4229-9b36-f16b98c654e7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:11.626618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:11.632318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bbaca-bb52-4229-9b36-f16b98c654e7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:11.638631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437deb1-cd53-4e32-8958-4e0ccfc6c31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:11.639545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437deb1-cd53-4e32-8958-4e0ccfc6c31c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.639827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437deb1-cd53-4e32-8958-4e0ccfc6c31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.640101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437deb1-cd53-4e32-8958-4e0ccfc6c31c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.640756 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437deb1-cd53-4e32-8958-4e0ccfc6c31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:11.642465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437deb1-cd53-4e32-8958-4e0ccfc6c31c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:11.660603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1363/2688] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:11.662712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a051-5f59-4f31-92c7-fd704677412d admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:11.677278 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a051-5f59-4f31-92c7-fd704677412d admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:11.682653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caf67-d43f-476a-a43d-d4bae66f5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:11.683576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caf67-d43f-476a-a43d-d4bae66f5afa admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.683915 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caf67-d43f-476a-a43d-d4bae66f5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.684229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caf67-d43f-476a-a43d-d4bae66f5afa admin admin] PATH_INFO: `/v3/projects/469da1cbb7df416d9d72b63ed180f7d7/users/2ac0e8117a1e4c32b14b2e0c338e8573/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.703169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caf67-d43f-476a-a43d-d4bae66f5afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=469da1cbb7df416d9d72b63ed180f7d7, user_id=2ac0e8117a1e4c32b14b2e0c338e8573, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:11.707761 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caf67-d43f-476a-a43d-d4bae66f5afa admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:11.727763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1326/2689] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:11 2022] PUT /identity/v3/projects/469da1cbb7df416d9d72b63ed180f7d7/users/2ac0e8117a1e4c32b14b2e0c338e8573/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:11.733191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437deb1-cd53-4e32-8958-4e0ccfc6c31c admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:11.746918 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437deb1-cd53-4e32-8958-4e0ccfc6c31c admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:11.868603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ff956-a78b-4f3e-82ae-f7cfe4d30aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:11.869249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ff956-a78b-4f3e-82ae-f7cfe4d30aed admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.869532 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ff956-a78b-4f3e-82ae-f7cfe4d30aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.869809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ff956-a78b-4f3e-82ae-f7cfe4d30aed admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.870490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ff956-a78b-4f3e-82ae-f7cfe4d30aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:11.872633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ff956-a78b-4f3e-82ae-f7cfe4d30aed admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:11.890074 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1364/2690] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:11.894474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caf67-d43f-476a-a43d-d4bae66f5afa admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:11.909648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caf67-d43f-476a-a43d-d4bae66f5afa admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:11.926322 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bb686-5ed9-45df-9658-bde030fcd050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:11.927466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bb686-5ed9-45df-9658-bde030fcd050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:11.927947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bb686-5ed9-45df-9658-bde030fcd050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:11.929042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bb686-5ed9-45df-9658-bde030fcd050 admin admin] PATH_INFO: `/v3/projects/469da1cbb7df416d9d72b63ed180f7d7/users/2ac0e8117a1e4c32b14b2e0c338e8573/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:11.938812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bb686-5ed9-45df-9658-bde030fcd050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469da1cbb7df416d9d72b63ed180f7d7, user_id=2ac0e8117a1e4c32b14b2e0c338e8573, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:11.942816 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bb686-5ed9-45df-9658-bde030fcd050 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:11.981290 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1327/2691] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:11 2022] PUT /identity/v3/projects/469da1cbb7df416d9d72b63ed180f7d7/users/2ac0e8117a1e4c32b14b2e0c338e8573/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:11.999407 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ff956-a78b-4f3e-82ae-f7cfe4d30aed admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:12.003929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-cb5ff956-a78b-4f3e-82ae-f7cfe4d30aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.028284 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ff956-a78b-4f3e-82ae-f7cfe4d30aed admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:12.052778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589e152-9cfc-44d7-971d-cb1a329cdf22 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:12.053360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589e152-9cfc-44d7-971d-cb1a329cdf22 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:12.053789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589e152-9cfc-44d7-971d-cb1a329cdf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:12.100937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-e589e152-9cfc-44d7-971d-cb1a329cdf22 None None] MFA Rules not processed for user `2ac0e8117a1e4c32b14b2e0c338e8573`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:12.103137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e589e152-9cfc-44d7-971d-cb1a329cdf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.128670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:12.130436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:12.130888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:12.132341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] PATH_INFO: `/v3/users/4a31911f673740fb8ea42e4bbf28f021` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:12.134004 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a31911f673740fb8ea42e4bbf28f021)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:12.137314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:12.203075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1328/2692] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:12.212650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589e152-9cfc-44d7-971d-cb1a329cdf22 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:12.214749 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e589e152-9cfc-44d7-971d-cb1a329cdf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.233649 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a31911f673740fb8ea42e4bbf28f021'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:12.252213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a31911f673740fb8ea42e4bbf28f021'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:12.253347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a31911f673740fb8ea42e4bbf28f021'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:12.266582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a31911f673740fb8ea42e4bbf28f021'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:12.268969 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5392897c-d4dd-4980-83a7-093c92416b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a31911f673740fb8ea42e4bbf28f021'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:12.304052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1365/2693] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:11 2022] DELETE /identity/v3/users/4a31911f673740fb8ea42e4bbf28f021 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:12.308863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b874b-6a57-4ba2-8b34-256acd3757d9 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:12.314299 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b874b-6a57-4ba2-8b34-256acd3757d9 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:12.314690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b874b-6a57-4ba2-8b34-256acd3757d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:12.343396 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589e152-9cfc-44d7-971d-cb1a329cdf22 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:12.351569 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-687b874b-6a57-4ba2-8b34-256acd3757d9 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:12.352882 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-687b874b-6a57-4ba2-8b34-256acd3757d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.353636 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:12.360412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:12.442572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:12.443563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:12.443962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:12.444149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:12.451480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.611880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:12.615271 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:12.637536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1329/2694] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:48:12.658432 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1366/2695] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:12.689687 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:12.691575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.722175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b874b-6a57-4ba2-8b34-256acd3757d9 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:12.723815 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-687b874b-6a57-4ba2-8b34-256acd3757d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.752777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b874b-6a57-4ba2-8b34-256acd3757d9 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:12.765505 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f8c6b-b11a-4fda-aea3-a918df7de1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:12.766134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f8c6b-b11a-4fda-aea3-a918df7de1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:12.766416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f8c6b-b11a-4fda-aea3-a918df7de1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:12.766685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f8c6b-b11a-4fda-aea3-a918df7de1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:12.771340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-124f8c6b-b11a-4fda-aea3-a918df7de1d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:12.850281 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399cbd7-8d19-4112-85a4-6cde583919df service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:12.854968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4a4a-eec1-4848-9893-100ffce17df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:12.856625 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4a4a-eec1-4848-9893-100ffce17df3 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:12.857067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4a4a-eec1-4848-9893-100ffce17df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:12.857642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc4a4a-eec1-4848-9893-100ffce17df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:12.868878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc4a4a-eec1-4848-9893-100ffce17df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:12.870346 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc4a4a-eec1-4848-9893-100ffce17df3 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:12.883131 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1330/2696] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:12.901898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f8c6b-b11a-4fda-aea3-a918df7de1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:12.904822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f8c6b-b11a-4fda-aea3-a918df7de1d0 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:12.924806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1367/2697] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:13.488005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4a4a-eec1-4848-9893-100ffce17df3 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:13.493857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e2bc4a4a-eec1-4848-9893-100ffce17df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:13.528216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc4a4a-eec1-4848-9893-100ffce17df3 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:13.536232 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:13.537708 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:13.538469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:13.539256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] PATH_INFO: `/v3/projects/56563ac51e02430191e9196b97f77034` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:13.541455 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=56563ac51e02430191e9196b97f77034)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:13.547676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:13.666885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56563ac51e02430191e9196b97f77034', 'request_id': 'req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:13.673036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:13.681925 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56563ac51e02430191e9196b97f77034', 'request_id': 'req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:13.695446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56563ac51e02430191e9196b97f77034', 'request_id': 'req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:13.713456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] The token cache is being invalidate because project 56563ac51e02430191e9196b97f77034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:13.713755 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:13.714577 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-fcd2d8b8-d2bb-44c2-b048-f32d097e9d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:13.721815 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1331/2698] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:13 2022] DELETE /identity/v3/projects/56563ac51e02430191e9196b97f77034 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:13.723586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347fbce-5f06-409c-8930-6d07d9ea6989 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:13.724151 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347fbce-5f06-409c-8930-6d07d9ea6989 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:13.724282 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347fbce-5f06-409c-8930-6d07d9ea6989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:13.749733 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4347fbce-5f06-409c-8930-6d07d9ea6989 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:13.751005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4347fbce-5f06-409c-8930-6d07d9ea6989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:13.845236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1368/2699] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:13.854426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806760-3b38-42ad-8e7e-3676fde66ebf None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:13.854889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806760-3b38-42ad-8e7e-3676fde66ebf None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:13.855414 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3806760-3b38-42ad-8e7e-3676fde66ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:13.888811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-c3806760-3b38-42ad-8e7e-3676fde66ebf None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:13.890976 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-c3806760-3b38-42ad-8e7e-3676fde66ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:13.917555 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1332/2700] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:13.937480 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347fbce-5f06-409c-8930-6d07d9ea6989 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:13.953557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347fbce-5f06-409c-8930-6d07d9ea6989 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:13.959371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0204-6513-40ba-ba5c-bb68c3e74338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:13.960150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0204-6513-40ba-ba5c-bb68c3e74338 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:13.960433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0204-6513-40ba-ba5c-bb68c3e74338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:13.960710 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0204-6513-40ba-ba5c-bb68c3e74338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:13.961525 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a0204-6513-40ba-ba5c-bb68c3e74338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:48:13.961991 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a0204-6513-40ba-ba5c-bb68c3e74338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:13.964028 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a0204-6513-40ba-ba5c-bb68c3e74338 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:13.989390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1369/2701] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:48:13.998682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3806760-3b38-42ad-8e7e-3676fde66ebf None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:14.026005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3806760-3b38-42ad-8e7e-3676fde66ebf None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:14.042147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94771-9426-4aec-9bf4-72fec9cb7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:14.042696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94771-9426-4aec-9bf4-72fec9cb7da5 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:14.042696 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94771-9426-4aec-9bf4-72fec9cb7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:14.043297 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94771-9426-4aec-9bf4-72fec9cb7da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:14.055176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f94771-9426-4aec-9bf4-72fec9cb7da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:14.059454 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f94771-9426-4aec-9bf4-72fec9cb7da5 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:14.146499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1333/2702] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:13 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:14.152772 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0204-6513-40ba-ba5c-bb68c3e74338 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:14.169871 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0204-6513-40ba-ba5c-bb68c3e74338 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:14.225144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:14.258957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245a890-ff0a-4f71-bd46-b42badb62254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:14.259741 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245a890-ff0a-4f71-bd46-b42badb62254 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:14.260019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245a890-ff0a-4f71-bd46-b42badb62254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:14.260386 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245a890-ff0a-4f71-bd46-b42badb62254 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:14.261070 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245a890-ff0a-4f71-bd46-b42badb62254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:14.263645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245a890-ff0a-4f71-bd46-b42badb62254 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:14.298134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1370/2703] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:14 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:14.302456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94771-9426-4aec-9bf4-72fec9cb7da5 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:14.314476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f94771-9426-4aec-9bf4-72fec9cb7da5 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:14.319233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60aa25-a5f1-47a6-95cc-39e8bead1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:14.319859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60aa25-a5f1-47a6-95cc-39e8bead1874 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:14.320148 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60aa25-a5f1-47a6-95cc-39e8bead1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:14.320419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60aa25-a5f1-47a6-95cc-39e8bead1874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:14.321081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60aa25-a5f1-47a6-95cc-39e8bead1874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:14.322680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60aa25-a5f1-47a6-95cc-39e8bead1874 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:14.334561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1334/2704] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:14.338735 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245a890-ff0a-4f71-bd46-b42badb62254 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:14.350252 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245a890-ff0a-4f71-bd46-b42badb62254 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:14.356047 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ece573-dbec-4db4-a04e-e361d7262a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:14.356681 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ece573-dbec-4db4-a04e-e361d7262a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:14.356934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ece573-dbec-4db4-a04e-e361d7262a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:14.357204 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ece573-dbec-4db4-a04e-e361d7262a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:14.357862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ece573-dbec-4db4-a04e-e361d7262a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:14.359510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ece573-dbec-4db4-a04e-e361d7262a75 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:14.371818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1371/2705] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:14.380975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60aa25-a5f1-47a6-95cc-39e8bead1874 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:14.399402 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60aa25-a5f1-47a6-95cc-39e8bead1874 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:14.408758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428938bd-d0f6-4709-9e68-88e1fd14aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:14.410018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428938bd-d0f6-4709-9e68-88e1fd14aa89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:14.410596 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428938bd-d0f6-4709-9e68-88e1fd14aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:14.410991 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428938bd-d0f6-4709-9e68-88e1fd14aa89 admin admin] PATH_INFO: `/v3/projects/19b903aa374145198a6a169c1da9b68a/users/d37230ad2d5048609a778eb78b596137/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:14.439753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428938bd-d0f6-4709-9e68-88e1fd14aa89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b903aa374145198a6a169c1da9b68a, user_id=d37230ad2d5048609a778eb78b596137, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:14.446926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428938bd-d0f6-4709-9e68-88e1fd14aa89 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:14.474081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1335/2706] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:14 2022] PUT /identity/v3/projects/19b903aa374145198a6a169c1da9b68a/users/d37230ad2d5048609a778eb78b596137/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:14.488868 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a02ba-98ab-4c5b-bfb2-20cf71cff651 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:14.489234 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a02ba-98ab-4c5b-bfb2-20cf71cff651 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:14.489515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a02ba-98ab-4c5b-bfb2-20cf71cff651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:14.527791 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-bc9a02ba-98ab-4c5b-bfb2-20cf71cff651 None None] MFA Rules not processed for user `d37230ad2d5048609a778eb78b596137`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:14.529434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-bc9a02ba-98ab-4c5b-bfb2-20cf71cff651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:14.626664 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1372/2707] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:14.631941 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428938bd-d0f6-4709-9e68-88e1fd14aa89 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:14.916250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428938bd-d0f6-4709-9e68-88e1fd14aa89 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:14.934184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe6058-050c-43ab-a677-c7769be1185e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:14.936187 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe6058-050c-43ab-a677-c7769be1185e admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:14.936671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe6058-050c-43ab-a677-c7769be1185e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:14.939244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe6058-050c-43ab-a677-c7769be1185e admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:14.940195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe6058-050c-43ab-a677-c7769be1185e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:14.942767 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe6058-050c-43ab-a677-c7769be1185e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:15.004674 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1336/2708] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:14 2022] POST /identity/v3/projects => generated 371 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:15.011444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a02ba-98ab-4c5b-bfb2-20cf71cff651 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:15.056483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a02ba-98ab-4c5b-bfb2-20cf71cff651 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:15.182984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c37e-ed60-4e9b-baea-9e6d1d315ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:15.185580 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c37e-ed60-4e9b-baea-9e6d1d315ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:15.186074 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c37e-ed60-4e9b-baea-9e6d1d315ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:15.186399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c37e-ed60-4e9b-baea-9e6d1d315ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:15.189755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92c37e-ed60-4e9b-baea-9e6d1d315ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:15.192385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92c37e-ed60-4e9b-baea-9e6d1d315ad6 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:15.250755 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1373/2709] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:15 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:15.254006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe6058-050c-43ab-a677-c7769be1185e admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:15.275977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe6058-050c-43ab-a677-c7769be1185e admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:15.293908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a72a31-d705-4c65-84bf-2ccaf1468604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:15.296081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a72a31-d705-4c65-84bf-2ccaf1468604 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:15.296629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a72a31-d705-4c65-84bf-2ccaf1468604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:15.297238 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a72a31-d705-4c65-84bf-2ccaf1468604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:15.298159 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a72a31-d705-4c65-84bf-2ccaf1468604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:15.300975 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a72a31-d705-4c65-84bf-2ccaf1468604 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:15.339240 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1337/2710] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:48:15.345864 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c37e-ed60-4e9b-baea-9e6d1d315ad6 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:15.372193 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c37e-ed60-4e9b-baea-9e6d1d315ad6 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:15.398265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf1a75-c869-406f-bf91-ed765cbfa64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:15.402972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1a75-c869-406f-bf91-ed765cbfa64d admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:15.402972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1a75-c869-406f-bf91-ed765cbfa64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:15.402972 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf1a75-c869-406f-bf91-ed765cbfa64d admin admin] PATH_INFO: `/v3/projects/93eb98a31e524dc2b9a36623e44124f6/users/cf2e21d0feb14168b3a97f97b031307d/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:15.452788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf1a75-c869-406f-bf91-ed765cbfa64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=93eb98a31e524dc2b9a36623e44124f6, user_id=cf2e21d0feb14168b3a97f97b031307d, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:15.462333 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf1a75-c869-406f-bf91-ed765cbfa64d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:15.496641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1374/2711] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:15 2022] PUT /identity/v3/projects/93eb98a31e524dc2b9a36623e44124f6/users/cf2e21d0feb14168b3a97f97b031307d/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:15.501022 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a72a31-d705-4c65-84bf-2ccaf1468604 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:15.543123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a72a31-d705-4c65-84bf-2ccaf1468604 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:15.751908 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:15.775926 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a982e-82d3-4334-befa-9e61b8b95b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:15.776962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a982e-82d3-4334-befa-9e61b8b95b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:15.777339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a982e-82d3-4334-befa-9e61b8b95b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:15.778126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a982e-82d3-4334-befa-9e61b8b95b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:15.779473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a982e-82d3-4334-befa-9e61b8b95b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:15.781743 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a982e-82d3-4334-befa-9e61b8b95b21 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:15.813320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1338/2712] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:15.815325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf1a75-c869-406f-bf91-ed765cbfa64d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:15.831769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf1a75-c869-406f-bf91-ed765cbfa64d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:15.841775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54969-8c63-4f76-a1b7-6f351e2b7b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:15.842820 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54969-8c63-4f76-a1b7-6f351e2b7b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:15.843401 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54969-8c63-4f76-a1b7-6f351e2b7b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:15.843748 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54969-8c63-4f76-a1b7-6f351e2b7b74 admin admin] PATH_INFO: `/v3/projects/93eb98a31e524dc2b9a36623e44124f6/users/cf2e21d0feb14168b3a97f97b031307d/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:15.847875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f54969-8c63-4f76-a1b7-6f351e2b7b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93eb98a31e524dc2b9a36623e44124f6, user_id=cf2e21d0feb14168b3a97f97b031307d, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:15.852209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f54969-8c63-4f76-a1b7-6f351e2b7b74 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:15.858985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:15.878348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1375/2713] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:15 2022] PUT /identity/v3/projects/93eb98a31e524dc2b9a36623e44124f6/users/cf2e21d0feb14168b3a97f97b031307d/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:15.890303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf612c3-c7b7-4dfe-865a-f5aec1e93035 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:15.890635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf612c3-c7b7-4dfe-865a-f5aec1e93035 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:15.891067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf612c3-c7b7-4dfe-865a-f5aec1e93035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:15.964333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-bdf612c3-c7b7-4dfe-865a-f5aec1e93035 None None] MFA Rules not processed for user `cf2e21d0feb14168b3a97f97b031307d`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:15.966777 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bdf612c3-c7b7-4dfe-865a-f5aec1e93035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:16.127279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1339/2714] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:16.146141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54969-8c63-4f76-a1b7-6f351e2b7b74 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:16.150310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-64f54969-8c63-4f76-a1b7-6f351e2b7b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:16.262529 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54969-8c63-4f76-a1b7-6f351e2b7b74 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:16.266769 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5eefc-7e10-4dae-9d10-93585554d2be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:16.267456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5eefc-7e10-4dae-9d10-93585554d2be service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:16.267786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5eefc-7e10-4dae-9d10-93585554d2be service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:16.268064 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5eefc-7e10-4dae-9d10-93585554d2be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:16.285082 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5eefc-7e10-4dae-9d10-93585554d2be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:16.286720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5eefc-7e10-4dae-9d10-93585554d2be service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:16.299953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1376/2715] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:16.395585 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf612c3-c7b7-4dfe-865a-f5aec1e93035 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:16.408269 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf612c3-c7b7-4dfe-865a-f5aec1e93035 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:16.413892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b9242-a596-49d7-aaee-71382b6b0c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:16.414542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b9242-a596-49d7-aaee-71382b6b0c59 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:16.414906 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b9242-a596-49d7-aaee-71382b6b0c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:16.415225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b9242-a596-49d7-aaee-71382b6b0c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:16.498056 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b9242-a596-49d7-aaee-71382b6b0c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:16.499774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b9242-a596-49d7-aaee-71382b6b0c59 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:16.515332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1340/2716] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:16.786624 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5eefc-7e10-4dae-9d10-93585554d2be service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:16.788855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fae5eefc-7e10-4dae-9d10-93585554d2be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:16.874101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5eefc-7e10-4dae-9d10-93585554d2be service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:16.882420 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:16.883444 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:16.883893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:16.884330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] PATH_INFO: `/v3/users/47d74020251d4299b2ca135a198b9a20` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:16.886137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d74020251d4299b2ca135a198b9a20)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:16.890011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:16.974310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d74020251d4299b2ca135a198b9a20'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:16.989793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d74020251d4299b2ca135a198b9a20'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:16.990697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d74020251d4299b2ca135a198b9a20'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.000744 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d74020251d4299b2ca135a198b9a20'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.001433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d74020251d4299b2ca135a198b9a20'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.018863 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1377/2717] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:16 2022] DELETE /identity/v3/users/47d74020251d4299b2ca135a198b9a20 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:17.024376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aec13-3211-49a1-b2b6-fe40b1e5d7bd None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:17.025025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aec13-3211-49a1-b2b6-fe40b1e5d7bd None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:17.025025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aec13-3211-49a1-b2b6-fe40b1e5d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:17.047324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-6d4aec13-3211-49a1-b2b6-fe40b1e5d7bd None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:17.048578 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6d4aec13-3211-49a1-b2b6-fe40b1e5d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:17.111778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1341/2718] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:17.122481 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:17.123994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:17.146866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:17.190035 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d2a17-22ef-4d03-9d97-6c319b2e0cba admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:17.195635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b85c29-947c-4c3b-ad01-75558c87263c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:17.196584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b85c29-947c-4c3b-ad01-75558c87263c service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:17.197037 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b85c29-947c-4c3b-ad01-75558c87263c service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:17.197453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b85c29-947c-4c3b-ad01-75558c87263c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:17.211959 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b85c29-947c-4c3b-ad01-75558c87263c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:17.213599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b85c29-947c-4c3b-ad01-75558c87263c service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:17.225547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1378/2719] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:17.536038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aec13-3211-49a1-b2b6-fe40b1e5d7bd None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:17.537730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-6d4aec13-3211-49a1-b2b6-fe40b1e5d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:17.555686 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aec13-3211-49a1-b2b6-fe40b1e5d7bd None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:17.562392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:17.563139 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:17.563492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:17.563803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] PATH_INFO: `/v3/projects/86cb0aa1244a4c71b1d83ac98fa77bcd` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:17.565328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] RBAC: Authorizing `identity:delete_project(project_id=86cb0aa1244a4c71b1d83ac98fa77bcd)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:17.567619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:17.577857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:17.630875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86cb0aa1244a4c71b1d83ac98fa77bcd', 'request_id': 'req-f5501159-f072-492f-915b-67ee7ed8f05e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.643878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86cb0aa1244a4c71b1d83ac98fa77bcd', 'request_id': 'req-f5501159-f072-492f-915b-67ee7ed8f05e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.651778 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86cb0aa1244a4c71b1d83ac98fa77bcd', 'request_id': 'req-f5501159-f072-492f-915b-67ee7ed8f05e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.665626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] The token cache is being invalidate because project 86cb0aa1244a4c71b1d83ac98fa77bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:17.665927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.666629 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.669084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1342/2720] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:17 2022] DELETE /identity/v3/projects/86cb0aa1244a4c71b1d83ac98fa77bcd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:17.674323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b85c29-947c-4c3b-ad01-75558c87263c service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:17.686190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b85c29-947c-4c3b-ad01-75558c87263c service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:17.756646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:17.757303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:17.757588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:17.757861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] PATH_INFO: `/v3/users/2033c5f93674452f95ace12e11795274` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:17.759179 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2033c5f93674452f95ace12e11795274)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:17.761451 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:17.877127 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2033c5f93674452f95ace12e11795274'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.907427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2033c5f93674452f95ace12e11795274'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.908452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2033c5f93674452f95ace12e11795274'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.920180 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2033c5f93674452f95ace12e11795274'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.921628 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2033c5f93674452f95ace12e11795274'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:17.940597 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1379/2721] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:17 2022] DELETE /identity/v3/users/2033c5f93674452f95ace12e11795274 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:18.407053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:18.408736 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:18.423940 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5501159-f072-492f-915b-67ee7ed8f05e admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:18.485790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:18.486434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:18.486714 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:18.487368 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] PATH_INFO: `/v3/projects/1ffbbfac60d847348c234d507e8cbdde` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:18.488364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffbbfac60d847348c234d507e8cbdde)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:18.490270 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:18.546709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffbbfac60d847348c234d507e8cbdde', 'request_id': 'req-b47dd39a-1635-4f04-8903-1ecde6e516e1'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.555494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffbbfac60d847348c234d507e8cbdde', 'request_id': 'req-b47dd39a-1635-4f04-8903-1ecde6e516e1'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.562747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffbbfac60d847348c234d507e8cbdde', 'request_id': 'req-b47dd39a-1635-4f04-8903-1ecde6e516e1'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.576087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] The token cache is being invalidate because project 1ffbbfac60d847348c234d507e8cbdde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:18.576312 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.577082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.578476 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1343/2722] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:18 2022] DELETE /identity/v3/projects/1ffbbfac60d847348c234d507e8cbdde => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:18.583072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:18.584714 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:18.599273 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628602f4-167d-456a-85b0-0a91a9600d5d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:18.648857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:18.675498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:18.676302 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:18.677547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:18.677547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] PATH_INFO: `/v3/users/2ac0e8117a1e4c32b14b2e0c338e8573` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:18.678281 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac0e8117a1e4c32b14b2e0c338e8573)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:18.680437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:18.751376 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac0e8117a1e4c32b14b2e0c338e8573'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.771544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac0e8117a1e4c32b14b2e0c338e8573'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.772287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac0e8117a1e4c32b14b2e0c338e8573'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.783159 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac0e8117a1e4c32b14b2e0c338e8573'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.784166 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fbbfc886-ba52-4c78-b120-1a18e902c192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac0e8117a1e4c32b14b2e0c338e8573'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:18.800239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1380/2723] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:18 2022] DELETE /identity/v3/users/2ac0e8117a1e4c32b14b2e0c338e8573 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:19.143226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:19.145048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:19.160289 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dd39a-1635-4f04-8903-1ecde6e516e1 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:19.189368 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:19.239937 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:19.240708 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.241130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.241421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] PATH_INFO: `/v3/projects/469da1cbb7df416d9d72b63ed180f7d7` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.242810 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469da1cbb7df416d9d72b63ed180f7d7)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:19.244871 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:19.308905 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469da1cbb7df416d9d72b63ed180f7d7', 'request_id': 'req-edf192b1-13fc-4489-9d01-9001dcb07650'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:19.328515 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469da1cbb7df416d9d72b63ed180f7d7', 'request_id': 'req-edf192b1-13fc-4489-9d01-9001dcb07650'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:19.338163 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469da1cbb7df416d9d72b63ed180f7d7', 'request_id': 'req-edf192b1-13fc-4489-9d01-9001dcb07650'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:19.354109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] The token cache is being invalidate because project 469da1cbb7df416d9d72b63ed180f7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:19.354451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:19.355261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-edf192b1-13fc-4489-9d01-9001dcb07650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:19.357766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1344/2724] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:19 2022] DELETE /identity/v3/projects/469da1cbb7df416d9d72b63ed180f7d7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:19.365346 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5076e-cfdb-4f39-a4f8-7a893d2190ec None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.365627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5076e-cfdb-4f39-a4f8-7a893d2190ec None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.365900 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5076e-cfdb-4f39-a4f8-7a893d2190ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.386497 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-51b5076e-cfdb-4f39-a4f8-7a893d2190ec None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:19.387948 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-51b5076e-cfdb-4f39-a4f8-7a893d2190ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:19.467842 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1381/2725] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:19.482256 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130b0d6-6c90-4744-8e39-ecc3b279ec5f None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.483123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130b0d6-6c90-4744-8e39-ecc3b279ec5f None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.483123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130b0d6-6c90-4744-8e39-ecc3b279ec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.503422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1130b0d6-6c90-4744-8e39-ecc3b279ec5f None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:19.504645 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1130b0d6-6c90-4744-8e39-ecc3b279ec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:19.513652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1345/2726] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:19.518185 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5076e-cfdb-4f39-a4f8-7a893d2190ec None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:19.530065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5076e-cfdb-4f39-a4f8-7a893d2190ec None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:19.535350 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e36d34-6cba-48c1-a856-3488129ebe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:19.535953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e36d34-6cba-48c1-a856-3488129ebe86 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.536238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e36d34-6cba-48c1-a856-3488129ebe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.536518 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e36d34-6cba-48c1-a856-3488129ebe86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.537181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e36d34-6cba-48c1-a856-3488129ebe86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:48:19.537498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e36d34-6cba-48c1-a856-3488129ebe86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:19.539268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e36d34-6cba-48c1-a856-3488129ebe86 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:19.553317 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1382/2727] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:48:19.558130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130b0d6-6c90-4744-8e39-ecc3b279ec5f None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:19.568196 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130b0d6-6c90-4744-8e39-ecc3b279ec5f None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:19.573709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f0a2c-6e38-4f9d-8577-ef93304a5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:19.574865 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f0a2c-6e38-4f9d-8577-ef93304a5f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.575192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f0a2c-6e38-4f9d-8577-ef93304a5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.575461 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f0a2c-6e38-4f9d-8577-ef93304a5f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.576890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f0a2c-6e38-4f9d-8577-ef93304a5f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:19.578343 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f0a2c-6e38-4f9d-8577-ef93304a5f9f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:19.611365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1346/2728] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:19 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:19.615984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e36d34-6cba-48c1-a856-3488129ebe86 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:19.627095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e36d34-6cba-48c1-a856-3488129ebe86 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:19.683550 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:19.701233 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2990b64-8867-4178-84bb-58cd6d4f349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:19.701975 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2990b64-8867-4178-84bb-58cd6d4f349f admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.702373 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2990b64-8867-4178-84bb-58cd6d4f349f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.702998 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2990b64-8867-4178-84bb-58cd6d4f349f admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.703774 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2990b64-8867-4178-84bb-58cd6d4f349f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:19.706639 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2990b64-8867-4178-84bb-58cd6d4f349f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:19.738516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1383/2729] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:19 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:19.743117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f0a2c-6e38-4f9d-8577-ef93304a5f9f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:19.762655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f0a2c-6e38-4f9d-8577-ef93304a5f9f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:19.768331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d8a9-411d-4678-9d4d-0f50d76fcfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:19.768948 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d8a9-411d-4678-9d4d-0f50d76fcfff admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.769248 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d8a9-411d-4678-9d4d-0f50d76fcfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.769500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355d8a9-411d-4678-9d4d-0f50d76fcfff admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.770233 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355d8a9-411d-4678-9d4d-0f50d76fcfff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:19.771879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355d8a9-411d-4678-9d4d-0f50d76fcfff admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:19.785078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1347/2730] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:48:19.788672 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2990b64-8867-4178-84bb-58cd6d4f349f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:19.800275 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2990b64-8867-4178-84bb-58cd6d4f349f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:19.806679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c850537-556a-4e96-818c-a2a3393fb471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:19.807539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c850537-556a-4e96-818c-a2a3393fb471 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.807920 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c850537-556a-4e96-818c-a2a3393fb471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.808294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c850537-556a-4e96-818c-a2a3393fb471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.809703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c850537-556a-4e96-818c-a2a3393fb471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:19.812246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c850537-556a-4e96-818c-a2a3393fb471 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:19.827293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1384/2731] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:48:19.835321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d8a9-411d-4678-9d4d-0f50d76fcfff admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:19.849046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355d8a9-411d-4678-9d4d-0f50d76fcfff admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:19.854105 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700252b9-4dc1-49b6-af78-fbcb66964d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:19.854817 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700252b9-4dc1-49b6-af78-fbcb66964d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.855132 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700252b9-4dc1-49b6-af78-fbcb66964d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.855409 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700252b9-4dc1-49b6-af78-fbcb66964d92 admin admin] PATH_INFO: `/v3/projects/d747673ba5d84d539959a334f7caf158/users/bf768190ec92468eac30453af257bedb/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.872823 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700252b9-4dc1-49b6-af78-fbcb66964d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d747673ba5d84d539959a334f7caf158, user_id=bf768190ec92468eac30453af257bedb, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:19.875509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700252b9-4dc1-49b6-af78-fbcb66964d92 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:19.890820 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1348/2732] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:19 2022] PUT /identity/v3/projects/d747673ba5d84d539959a334f7caf158/users/bf768190ec92468eac30453af257bedb/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:19.903167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a331dbc-01ee-46c6-bd88-276b4a725aae None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:19.903586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a331dbc-01ee-46c6-bd88-276b4a725aae None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:19.904139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a331dbc-01ee-46c6-bd88-276b4a725aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:19.940729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9a331dbc-01ee-46c6-bd88-276b4a725aae None None] MFA Rules not processed for user `bf768190ec92468eac30453af257bedb`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:19.942086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9a331dbc-01ee-46c6-bd88-276b4a725aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:20.013488 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1385/2733] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:20.018086 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700252b9-4dc1-49b6-af78-fbcb66964d92 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:20.079464 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:20.091766 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700252b9-4dc1-49b6-af78-fbcb66964d92 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:20.098351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c7bc-d180-4563-8f4e-7af853d79f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:20.098995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c7bc-d180-4563-8f4e-7af853d79f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.099389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c7bc-d180-4563-8f4e-7af853d79f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.099549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a7c7bc-d180-4563-8f4e-7af853d79f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.100189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7c7bc-d180-4563-8f4e-7af853d79f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:20.102160 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a7c7bc-d180-4563-8f4e-7af853d79f3a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:20.131635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1349/2734] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:20 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:20.141563 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a331dbc-01ee-46c6-bd88-276b4a725aae None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:20.158732 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a331dbc-01ee-46c6-bd88-276b4a725aae None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:20.252054 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b66f0a-2ccd-4c01-bd24-877a76c3df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:20.253181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66f0a-2ccd-4c01-bd24-877a76c3df0d admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.253816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66f0a-2ccd-4c01-bd24-877a76c3df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.254151 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66f0a-2ccd-4c01-bd24-877a76c3df0d admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.255399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b66f0a-2ccd-4c01-bd24-877a76c3df0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:20.259326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b66f0a-2ccd-4c01-bd24-877a76c3df0d admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:20.291304 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1386/2735] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:20 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:20.296429 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c7bc-d180-4563-8f4e-7af853d79f3a admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:20.307993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a7c7bc-d180-4563-8f4e-7af853d79f3a admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:20.313617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ba5fd-22af-419c-8915-35fd6eb65c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:20.314340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ba5fd-22af-419c-8915-35fd6eb65c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.314620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ba5fd-22af-419c-8915-35fd6eb65c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.314894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ba5fd-22af-419c-8915-35fd6eb65c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.315580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ba5fd-22af-419c-8915-35fd6eb65c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:20.317191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ba5fd-22af-419c-8915-35fd6eb65c88 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:20.328862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1350/2736] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:48:20.333482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b66f0a-2ccd-4c01-bd24-877a76c3df0d admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:20.344017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b66f0a-2ccd-4c01-bd24-877a76c3df0d admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:20.351139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471af2d-a181-40fe-bec6-914ab27cdb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:20.351811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471af2d-a181-40fe-bec6-914ab27cdb30 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.352196 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471af2d-a181-40fe-bec6-914ab27cdb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.352514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471af2d-a181-40fe-bec6-914ab27cdb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.353215 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471af2d-a181-40fe-bec6-914ab27cdb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:20.354904 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471af2d-a181-40fe-bec6-914ab27cdb30 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:20.366861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1387/2737] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:20.372681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ba5fd-22af-419c-8915-35fd6eb65c88 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:20.396058 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ba5fd-22af-419c-8915-35fd6eb65c88 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:20.403123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e28365-f71c-4af1-bd8f-b8e93750bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:20.403803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e28365-f71c-4af1-bd8f-b8e93750bcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.404166 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e28365-f71c-4af1-bd8f-b8e93750bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.404469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e28365-f71c-4af1-bd8f-b8e93750bcf2 admin admin] PATH_INFO: `/v3/projects/faaf4b48d84f4a809fed4d85e3b1fb63/users/807f40520e4e41ce9bf8b1e595623f10/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.423373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e28365-f71c-4af1-bd8f-b8e93750bcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaf4b48d84f4a809fed4d85e3b1fb63, user_id=807f40520e4e41ce9bf8b1e595623f10, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:20.426300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e28365-f71c-4af1-bd8f-b8e93750bcf2 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:20.444149 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1351/2738] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:20 2022] PUT /identity/v3/projects/faaf4b48d84f4a809fed4d85e3b1fb63/users/807f40520e4e41ce9bf8b1e595623f10/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:20.457343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113555b-0326-471c-a185-002735a82443 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.457343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113555b-0326-471c-a185-002735a82443 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.457567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113555b-0326-471c-a185-002735a82443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.494310 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9113555b-0326-471c-a185-002735a82443 None None] MFA Rules not processed for user `807f40520e4e41ce9bf8b1e595623f10`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:20.495633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9113555b-0326-471c-a185-002735a82443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:20.520620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:20.593067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1388/2739] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:20.598342 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e28365-f71c-4af1-bd8f-b8e93750bcf2 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:20.705558 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e28365-f71c-4af1-bd8f-b8e93750bcf2 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:20.711468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d7cce-ace2-44ed-a786-211f7af789b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:20.712221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d7cce-ace2-44ed-a786-211f7af789b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.712655 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d7cce-ace2-44ed-a786-211f7af789b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.713111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d7cce-ace2-44ed-a786-211f7af789b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.713936 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d7cce-ace2-44ed-a786-211f7af789b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:20.716658 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d7cce-ace2-44ed-a786-211f7af789b7 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:20.752095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1352/2740] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:20 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:20.753530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113555b-0326-471c-a185-002735a82443 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:20.765577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113555b-0326-471c-a185-002735a82443 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:20.840609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c036-4c3f-4c07-949e-fcdc66352112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:20.841271 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c036-4c3f-4c07-949e-fcdc66352112 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.841618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c036-4c3f-4c07-949e-fcdc66352112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.841880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c036-4c3f-4c07-949e-fcdc66352112 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.842743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01c036-4c3f-4c07-949e-fcdc66352112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:20.844478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01c036-4c3f-4c07-949e-fcdc66352112 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:20.878483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1389/2741] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:20 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:20.879690 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d7cce-ace2-44ed-a786-211f7af789b7 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:20.891095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d7cce-ace2-44ed-a786-211f7af789b7 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:20.897443 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447ce40-428e-47d5-afd0-babe0e31154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:20.898310 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ce40-428e-47d5-afd0-babe0e31154c admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.898628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ce40-428e-47d5-afd0-babe0e31154c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.899011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447ce40-428e-47d5-afd0-babe0e31154c admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.899827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447ce40-428e-47d5-afd0-babe0e31154c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:20.901863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447ce40-428e-47d5-afd0-babe0e31154c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:20.917292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1353/2742] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:20.923080 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c036-4c3f-4c07-949e-fcdc66352112 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:20.940449 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c036-4c3f-4c07-949e-fcdc66352112 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:20.948734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0be9-d893-4b7a-85f3-11c771eb7099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:20.950135 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0be9-d893-4b7a-85f3-11c771eb7099 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:20.950586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0be9-d893-4b7a-85f3-11c771eb7099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:20.951072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0be9-d893-4b7a-85f3-11c771eb7099 admin admin] PATH_INFO: `/v3/projects/10157132084b4676a7920fb30501207b/users/dedc8ac9cafe4f298c7ded500fbf8186/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:20.981264 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0be9-d893-4b7a-85f3-11c771eb7099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10157132084b4676a7920fb30501207b, user_id=dedc8ac9cafe4f298c7ded500fbf8186, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:20.985813 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0be9-d893-4b7a-85f3-11c771eb7099 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:21.013528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1390/2743] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:20 2022] PUT /identity/v3/projects/10157132084b4676a7920fb30501207b/users/dedc8ac9cafe4f298c7ded500fbf8186/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:21.019738 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447ce40-428e-47d5-afd0-babe0e31154c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:21.037537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447ce40-428e-47d5-afd0-babe0e31154c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:21.129123 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded8c05-a3c1-4258-93aa-ebc790f3333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:21.129789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded8c05-a3c1-4258-93aa-ebc790f3333d admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:21.130059 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded8c05-a3c1-4258-93aa-ebc790f3333d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:21.130359 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded8c05-a3c1-4258-93aa-ebc790f3333d admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:21.131087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded8c05-a3c1-4258-93aa-ebc790f3333d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:21.132615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded8c05-a3c1-4258-93aa-ebc790f3333d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:21.145366 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1354/2744] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:21.149747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0be9-d893-4b7a-85f3-11c771eb7099 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:21.163853 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0be9-d893-4b7a-85f3-11c771eb7099 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:21.169111 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f724-2add-4d0f-8581-e665182f2b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:21.169798 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f724-2add-4d0f-8581-e665182f2b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:21.170077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f724-2add-4d0f-8581-e665182f2b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:21.170418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5f724-2add-4d0f-8581-e665182f2b30 admin admin] PATH_INFO: `/v3/projects/10157132084b4676a7920fb30501207b/users/dedc8ac9cafe4f298c7ded500fbf8186/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:21.172933 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f724-2add-4d0f-8581-e665182f2b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10157132084b4676a7920fb30501207b, user_id=dedc8ac9cafe4f298c7ded500fbf8186, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:21.176262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5f724-2add-4d0f-8581-e665182f2b30 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:21.190309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1391/2745] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:21 2022] PUT /identity/v3/projects/10157132084b4676a7920fb30501207b/users/dedc8ac9cafe4f298c7ded500fbf8186/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:21.203034 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37de2-e227-421b-afb7-0ac6b668f7af None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:21.203498 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37de2-e227-421b-afb7-0ac6b668f7af None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:21.203783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37de2-e227-421b-afb7-0ac6b668f7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:21.244750 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:21.248877 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-a3b37de2-e227-421b-afb7-0ac6b668f7af None None] MFA Rules not processed for user `dedc8ac9cafe4f298c7ded500fbf8186`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:21.254512 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a3b37de2-e227-421b-afb7-0ac6b668f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:21.373350 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1355/2746] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:21.388935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f724-2add-4d0f-8581-e665182f2b30 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:21.391740 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-60d5f724-2add-4d0f-8581-e665182f2b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:21.528360 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5f724-2add-4d0f-8581-e665182f2b30 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:21.536725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc94f32-5408-479f-bac0-132e3ffa9812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:21.538516 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc94f32-5408-479f-bac0-132e3ffa9812 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:21.538724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc94f32-5408-479f-bac0-132e3ffa9812 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:21.541291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc94f32-5408-479f-bac0-132e3ffa9812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:21.587559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:21.669077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc94f32-5408-479f-bac0-132e3ffa9812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:21.672465 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc94f32-5408-479f-bac0-132e3ffa9812 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:21.699922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1392/2747] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:48:21.792222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b37de2-e227-421b-afb7-0ac6b668f7af None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:21.795251 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a3b37de2-e227-421b-afb7-0ac6b668f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:21.951292 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b37de2-e227-421b-afb7-0ac6b668f7af None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:21.959068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a48ee6-248f-4856-a681-ee21501ed8df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:21.960122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a48ee6-248f-4856-a681-ee21501ed8df service placement] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:21.960122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a48ee6-248f-4856-a681-ee21501ed8df service placement] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:21.960444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a48ee6-248f-4856-a681-ee21501ed8df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:21.963231 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e8a48ee6-248f-4856-a681-ee21501ed8df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:21.984841 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a48ee6-248f-4856-a681-ee21501ed8df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:21.988173 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a48ee6-248f-4856-a681-ee21501ed8df service placement] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:22.007796 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1356/2748] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:23.502637 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc94f32-5408-479f-bac0-132e3ffa9812 service cinder] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:23.513685 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc94f32-5408-479f-bac0-132e3ffa9812 service cinder] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:23.517995 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc813d7-1fcf-40a7-b038-73641b709ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:23.518659 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc813d7-1fcf-40a7-b038-73641b709ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:23.518964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc813d7-1fcf-40a7-b038-73641b709ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:23.519245 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc813d7-1fcf-40a7-b038-73641b709ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:23.586985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc813d7-1fcf-40a7-b038-73641b709ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:23.588664 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc813d7-1fcf-40a7-b038-73641b709ac8 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:23.598823 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1393/2749] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:24.259044 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a48ee6-248f-4856-a681-ee21501ed8df service placement] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:24.269121 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a48ee6-248f-4856-a681-ee21501ed8df service placement] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:24.273753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388cac2-cd6c-468c-b15d-8532310f0ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:24.273753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388cac2-cd6c-468c-b15d-8532310f0ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:24.274146 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388cac2-cd6c-468c-b15d-8532310f0ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:24.274243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388cac2-cd6c-468c-b15d-8532310f0ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:24.294298 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388cac2-cd6c-468c-b15d-8532310f0ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:24.295804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388cac2-cd6c-468c-b15d-8532310f0ca5 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:24.307866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1357/2750] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:24.879574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0db95-af12-4c54-9432-e64d3b588a60 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:24.880145 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0db95-af12-4c54-9432-e64d3b588a60 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:24.880290 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0db95-af12-4c54-9432-e64d3b588a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:24.923291 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a4a0db95-af12-4c54-9432-e64d3b588a60 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:24.925455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a4a0db95-af12-4c54-9432-e64d3b588a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:25.005795 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1394/2751] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:48:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:25.023966 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388cac2-cd6c-468c-b15d-8532310f0ca5 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:25.025963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-a388cac2-cd6c-468c-b15d-8532310f0ca5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:25.109916 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=100 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:25.129230 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388cac2-cd6c-468c-b15d-8532310f0ca5 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:25.135980 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c613c-b2e1-4bbf-b89d-bdf5056d1012 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:25.137450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c613c-b2e1-4bbf-b89d-bdf5056d1012 service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:25.137890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c613c-b2e1-4bbf-b89d-bdf5056d1012 service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:25.138288 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c613c-b2e1-4bbf-b89d-bdf5056d1012 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:25.153103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c613c-b2e1-4bbf-b89d-bdf5056d1012 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:25.155964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c613c-b2e1-4bbf-b89d-bdf5056d1012 service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:25.167372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1358/2752] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:48:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:48:28.993944 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0db95-af12-4c54-9432-e64d3b588a60 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:29.104460 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0db95-af12-4c54-9432-e64d3b588a60 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:29.114144 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:29.118349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:29.118349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:29.118349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] PATH_INFO: `/v3/users/bf768190ec92468eac30453af257bedb` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:29.120512 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf768190ec92468eac30453af257bedb)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:29.125081 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:29.134638 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=100 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:29.237956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf768190ec92468eac30453af257bedb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:29.266886 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf768190ec92468eac30453af257bedb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:29.267930 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf768190ec92468eac30453af257bedb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:29.280645 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf768190ec92468eac30453af257bedb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:29.281560 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf768190ec92468eac30453af257bedb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:29.304001 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1395/2753] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:28 2022] DELETE /identity/v3/users/bf768190ec92468eac30453af257bedb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:29.309176 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1930d-deff-4fdd-b2b9-f4058f1e10c1 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:29.310004 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1930d-deff-4fdd-b2b9-f4058f1e10c1 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:29.310560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1930d-deff-4fdd-b2b9-f4058f1e10c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:29.384860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7dc1930d-deff-4fdd-b2b9-f4058f1e10c1 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:29.386260 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7dc1930d-deff-4fdd-b2b9-f4058f1e10c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:29.525775 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1359/2754] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:29.539011 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:29.540914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:29.695177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896644b-d526-4482-8d1c-1731f6f60be7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:29.700016 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234ecd0-4063-4eba-b894-d115efc85c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:29.700709 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234ecd0-4063-4eba-b894-d115efc85c1b service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:29.701072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234ecd0-4063-4eba-b894-d115efc85c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:29.701368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234ecd0-4063-4eba-b894-d115efc85c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:29.715620 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234ecd0-4063-4eba-b894-d115efc85c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:29.718042 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234ecd0-4063-4eba-b894-d115efc85c1b service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:29.731929 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1396/2755] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:30.124190 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1930d-deff-4fdd-b2b9-f4058f1e10c1 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:30.125727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7dc1930d-deff-4fdd-b2b9-f4058f1e10c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:30.144500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1930d-deff-4fdd-b2b9-f4058f1e10c1 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:30.150958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:30.151626 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:30.151902 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:30.152193 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] PATH_INFO: `/v3/projects/d747673ba5d84d539959a334f7caf158` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:30.153616 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d747673ba5d84d539959a334f7caf158)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:30.155903 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:30.251819 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd747673ba5d84d539959a334f7caf158', 'request_id': 'req-54d25f23-68a0-48c1-9f28-db5a90e51ed8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.266680 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd747673ba5d84d539959a334f7caf158', 'request_id': 'req-54d25f23-68a0-48c1-9f28-db5a90e51ed8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.278730 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd747673ba5d84d539959a334f7caf158', 'request_id': 'req-54d25f23-68a0-48c1-9f28-db5a90e51ed8'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.298417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] The token cache is being invalidate because project d747673ba5d84d539959a334f7caf158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:30.298890 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.300017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.302634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1360/2756] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:30 2022] DELETE /identity/v3/projects/d747673ba5d84d539959a334f7caf158 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:30.307692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234ecd0-4063-4eba-b894-d115efc85c1b service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:30.322256 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234ecd0-4063-4eba-b894-d115efc85c1b service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:30.412523 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:30.413668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:30.413957 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:30.414238 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] PATH_INFO: `/v3/users/807f40520e4e41ce9bf8b1e595623f10` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:30.415567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=807f40520e4e41ce9bf8b1e595623f10)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:30.417574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:30.428375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:30.506356 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807f40520e4e41ce9bf8b1e595623f10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.531061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807f40520e4e41ce9bf8b1e595623f10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.532582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807f40520e4e41ce9bf8b1e595623f10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.545697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807f40520e4e41ce9bf8b1e595623f10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.547607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807f40520e4e41ce9bf8b1e595623f10'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:30.577590 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1397/2757] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:30 2022] DELETE /identity/v3/users/807f40520e4e41ce9bf8b1e595623f10 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:31.041627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:31.044570 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:31.070501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25f23-68a0-48c1-9f28-db5a90e51ed8 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:31.191897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:31.193038 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:31.193827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:31.194389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] PATH_INFO: `/v3/projects/faaf4b48d84f4a809fed4d85e3b1fb63` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:31.196985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faaf4b48d84f4a809fed4d85e3b1fb63)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:31.201814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:31.225704 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:31.356024 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faaf4b48d84f4a809fed4d85e3b1fb63', 'request_id': 'req-2e52984e-8d15-413c-9533-27e47abbf709'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.396604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faaf4b48d84f4a809fed4d85e3b1fb63', 'request_id': 'req-2e52984e-8d15-413c-9533-27e47abbf709'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.408712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faaf4b48d84f4a809fed4d85e3b1fb63', 'request_id': 'req-2e52984e-8d15-413c-9533-27e47abbf709'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.431995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] The token cache is being invalidate because project faaf4b48d84f4a809fed4d85e3b1fb63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:31.432897 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.434345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.438434 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1361/2758] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:31 2022] DELETE /identity/v3/projects/faaf4b48d84f4a809fed4d85e3b1fb63 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:31.444348 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:31.448118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:31.471083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5cb72-68c3-454f-be66-051d4c20a5ce admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:31.559049 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:31.559835 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:31.560188 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:31.560539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] PATH_INFO: `/v3/users/dedc8ac9cafe4f298c7ded500fbf8186` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:31.561862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dedc8ac9cafe4f298c7ded500fbf8186)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:31.564025 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:31.636002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dedc8ac9cafe4f298c7ded500fbf8186'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.657268 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dedc8ac9cafe4f298c7ded500fbf8186'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.658434 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dedc8ac9cafe4f298c7ded500fbf8186'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.679304 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dedc8ac9cafe4f298c7ded500fbf8186'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.680326 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-cadd1212-6ac1-44c0-80bf-5a7b351e602f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dedc8ac9cafe4f298c7ded500fbf8186'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:31.705899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1398/2759] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:31 2022] DELETE /identity/v3/users/dedc8ac9cafe4f298c7ded500fbf8186 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:32.218699 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:32.220326 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:32.243632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52984e-8d15-413c-9533-27e47abbf709 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:32.339333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:32.340709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:32.341084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:32.341459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] PATH_INFO: `/v3/projects/10157132084b4676a7920fb30501207b` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:32.342727 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10157132084b4676a7920fb30501207b)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:32.344768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:32.449879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10157132084b4676a7920fb30501207b', 'request_id': 'req-ffde7f64-4b28-4ba4-81ae-4768c02e533e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:32.462787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10157132084b4676a7920fb30501207b', 'request_id': 'req-ffde7f64-4b28-4ba4-81ae-4768c02e533e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:32.476782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10157132084b4676a7920fb30501207b', 'request_id': 'req-ffde7f64-4b28-4ba4-81ae-4768c02e533e'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:32.502467 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] The token cache is being invalidate because project 10157132084b4676a7920fb30501207b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:32.503116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:32.504268 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-ffde7f64-4b28-4ba4-81ae-4768c02e533e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:32.507307 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1362/2760] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:32 2022] DELETE /identity/v3/projects/10157132084b4676a7920fb30501207b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:32.519500 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb351-723a-4453-8a3d-717407d0a636 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:32.520343 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb351-723a-4453-8a3d-717407d0a636 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:32.520482 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb351-723a-4453-8a3d-717407d0a636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:32.540950 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:32.568605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-7bfeb351-723a-4453-8a3d-717407d0a636 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:32.570544 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-7bfeb351-723a-4453-8a3d-717407d0a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:32.671914 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1399/2761] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:32.688812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9551-be33-400e-858c-47f8d1429fa2 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:32.689315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9551-be33-400e-858c-47f8d1429fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:32.690411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9551-be33-400e-858c-47f8d1429fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:32.733052 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-80df9551-be33-400e-858c-47f8d1429fa2 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:32.734791 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-80df9551-be33-400e-858c-47f8d1429fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:32.761535 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1363/2762] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:32.763861 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb351-723a-4453-8a3d-717407d0a636 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:32.778985 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb351-723a-4453-8a3d-717407d0a636 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:32.784615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6264ef-bf03-4c58-8eec-538a6d6b2fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:32.785872 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6264ef-bf03-4c58-8eec-538a6d6b2fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:32.788436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6264ef-bf03-4c58-8eec-538a6d6b2fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:32.788906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6264ef-bf03-4c58-8eec-538a6d6b2fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:32.789778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6264ef-bf03-4c58-8eec-538a6d6b2fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81766) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:48:32.790078 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6264ef-bf03-4c58-8eec-538a6d6b2fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:32.792020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6264ef-bf03-4c58-8eec-538a6d6b2fe9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:32.814745 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1400/2763] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:48:32.821151 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df9551-be33-400e-858c-47f8d1429fa2 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:32.836642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df9551-be33-400e-858c-47f8d1429fa2 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:32.842804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305bc22-447f-4337-94b9-ecbd10fb9bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:32.843806 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305bc22-447f-4337-94b9-ecbd10fb9bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:32.844410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305bc22-447f-4337-94b9-ecbd10fb9bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:32.845048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305bc22-447f-4337-94b9-ecbd10fb9bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:32.846627 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305bc22-447f-4337-94b9-ecbd10fb9bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:32.850382 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305bc22-447f-4337-94b9-ecbd10fb9bdf admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:32.891254 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:32.903757 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1364/2764] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:32 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:48:32.905979 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6264ef-bf03-4c58-8eec-538a6d6b2fe9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:32.924556 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6264ef-bf03-4c58-8eec-538a6d6b2fe9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:33.033899 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522605ca-277e-49d7-959c-cf945fc478da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:33.034790 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522605ca-277e-49d7-959c-cf945fc478da admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:33.035239 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522605ca-277e-49d7-959c-cf945fc478da admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:33.035761 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522605ca-277e-49d7-959c-cf945fc478da admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:33.036845 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522605ca-277e-49d7-959c-cf945fc478da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:33.039618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522605ca-277e-49d7-959c-cf945fc478da admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:33.093378 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1401/2765] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:32 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:33.098987 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305bc22-447f-4337-94b9-ecbd10fb9bdf admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:33.119341 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305bc22-447f-4337-94b9-ecbd10fb9bdf admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:33.127623 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d936ae-2829-4d23-a2a1-b3ea0ff7375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:33.128640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d936ae-2829-4d23-a2a1-b3ea0ff7375f admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:33.129069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d936ae-2829-4d23-a2a1-b3ea0ff7375f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:33.129478 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d936ae-2829-4d23-a2a1-b3ea0ff7375f admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:33.130470 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d936ae-2829-4d23-a2a1-b3ea0ff7375f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:33.133145 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d936ae-2829-4d23-a2a1-b3ea0ff7375f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:33.159469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1365/2766] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:33.161114 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522605ca-277e-49d7-959c-cf945fc478da admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:33.174060 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522605ca-277e-49d7-959c-cf945fc478da admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:33.183101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577fa84-4acb-4ffe-9223-8a13bf3a9b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:33.184663 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577fa84-4acb-4ffe-9223-8a13bf3a9b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:33.186106 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577fa84-4acb-4ffe-9223-8a13bf3a9b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:33.186610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577fa84-4acb-4ffe-9223-8a13bf3a9b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:33.187771 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577fa84-4acb-4ffe-9223-8a13bf3a9b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:33.189806 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577fa84-4acb-4ffe-9223-8a13bf3a9b48 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:33.212068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1402/2767] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:33.213523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d936ae-2829-4d23-a2a1-b3ea0ff7375f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:33.229914 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d936ae-2829-4d23-a2a1-b3ea0ff7375f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:33.237718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ea4c-58f5-47b9-8d9b-1a1566009ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:33.238403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ea4c-58f5-47b9-8d9b-1a1566009ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:33.238683 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ea4c-58f5-47b9-8d9b-1a1566009ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:33.238992 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70ea4c-58f5-47b9-8d9b-1a1566009ccb admin admin] PATH_INFO: `/v3/projects/9b11cd32804a4847874ddb0f1ee9f3b7/users/24246180165e4ce3bcf4eed25d5049fb/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:33.259700 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70ea4c-58f5-47b9-8d9b-1a1566009ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b11cd32804a4847874ddb0f1ee9f3b7, user_id=24246180165e4ce3bcf4eed25d5049fb, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:33.262790 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70ea4c-58f5-47b9-8d9b-1a1566009ccb admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:33.287072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1366/2768] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:33 2022] PUT /identity/v3/projects/9b11cd32804a4847874ddb0f1ee9f3b7/users/24246180165e4ce3bcf4eed25d5049fb/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:33.304506 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4dbd-7bd2-4258-8828-06e895c0df5e None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:33.304953 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4dbd-7bd2-4258-8828-06e895c0df5e None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:33.305354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4dbd-7bd2-4258-8828-06e895c0df5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:33.353248 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-f36d4dbd-7bd2-4258-8828-06e895c0df5e None None] MFA Rules not processed for user `24246180165e4ce3bcf4eed25d5049fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:33.354881 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-f36d4dbd-7bd2-4258-8828-06e895c0df5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:33.471558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:33.482743 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1403/2769] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:33.502994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ea4c-58f5-47b9-8d9b-1a1566009ccb admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:33.510535 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4e70ea4c-58f5-47b9-8d9b-1a1566009ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:33.598035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70ea4c-58f5-47b9-8d9b-1a1566009ccb admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:33.604127 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da6876-d48b-447f-9e70-3717d71c7399 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d055337c9a642bd9b8b5a60aacb11cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:33.604949 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da6876-d48b-447f-9e70-3717d71c7399 service glance] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:33.605427 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da6876-d48b-447f-9e70-3717d71c7399 service glance] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:33.606407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da6876-d48b-447f-9e70-3717d71c7399 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:33.625053 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da6876-d48b-447f-9e70-3717d71c7399 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:33.627979 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da6876-d48b-447f-9e70-3717d71c7399 service glance] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:33.646179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1367/2770] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:43.638279 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:50.805095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88724-43de-448d-9809-405c634cd1e2 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:50.805683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88724-43de-448d-9809-405c634cd1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:50.805683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88724-43de-448d-9809-405c634cd1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:50.830528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-3ae88724-43de-448d-9809-405c634cd1e2 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:50.832313 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3ae88724-43de-448d-9809-405c634cd1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:50.890599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1404/2771] 10.222.0.89 () {58 vars in 967 bytes} [Fri Aug 26 15:48:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:50.904095 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da6876-d48b-447f-9e70-3717d71c7399 service glance] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:50.905780 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-42da6876-d48b-447f-9e70-3717d71c7399 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:50.985480 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da6876-d48b-447f-9e70-3717d71c7399 service glance] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:50.993529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab13a62-8054-4e7e-9e9f-d4981b91fa68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:50.995501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab13a62-8054-4e7e-9e9f-d4981b91fa68 service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:50.995977 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab13a62-8054-4e7e-9e9f-d4981b91fa68 service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:50.997072 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab13a62-8054-4e7e-9e9f-d4981b91fa68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:51.029415 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab13a62-8054-4e7e-9e9f-d4981b91fa68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:51.031588 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab13a62-8054-4e7e-9e9f-d4981b91fa68 service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:51.040889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1368/2772] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:48:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:48:51.527634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88724-43de-448d-9809-405c634cd1e2 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:51.529538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3ae88724-43de-448d-9809-405c634cd1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:51.639668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88724-43de-448d-9809-405c634cd1e2 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:51.645567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:51.646413 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:51.646906 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:51.647383 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] PATH_INFO: `/v3/users/d37230ad2d5048609a778eb78b596137` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:51.649046 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37230ad2d5048609a778eb78b596137)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:51.651498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:51.718422 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37230ad2d5048609a778eb78b596137'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:51.736287 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37230ad2d5048609a778eb78b596137'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:51.737241 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37230ad2d5048609a778eb78b596137'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:51.749409 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37230ad2d5048609a778eb78b596137'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:51.750375 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37230ad2d5048609a778eb78b596137'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:51.765366 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1405/2773] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:51 2022] DELETE /identity/v3/users/d37230ad2d5048609a778eb78b596137 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:51.770492 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23e81-a757-4b63-bf2d-383736fcd135 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:51.770818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23e81-a757-4b63-bf2d-383736fcd135 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:51.771168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b23e81-a757-4b63-bf2d-383736fcd135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:51.792501 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-d4b23e81-a757-4b63-bf2d-383736fcd135 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:51.794566 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d4b23e81-a757-4b63-bf2d-383736fcd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:51.891113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1369/2774] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:51.901974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:51.903658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:51.948147 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:51.998564 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf8033-9598-421d-b539-c5930cdb77a7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:52.004068 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc15eb-5989-4d42-9ff2-76c8b33b39bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:52.004880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc15eb-5989-4d42-9ff2-76c8b33b39bb service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:52.005295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc15eb-5989-4d42-9ff2-76c8b33b39bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:52.005713 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc15eb-5989-4d42-9ff2-76c8b33b39bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:52.019938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc15eb-5989-4d42-9ff2-76c8b33b39bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:52.022246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc15eb-5989-4d42-9ff2-76c8b33b39bb service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:52.038679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1406/2775] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:48:52.379331 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23e81-a757-4b63-bf2d-383736fcd135 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:52.381275 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-d4b23e81-a757-4b63-bf2d-383736fcd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:52.412036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b23e81-a757-4b63-bf2d-383736fcd135 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:52.421518 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:52.422421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:52.422744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:52.423126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] PATH_INFO: `/v3/projects/19b903aa374145198a6a169c1da9b68a` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:52.424744 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b903aa374145198a6a169c1da9b68a)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:52.426731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:52.483753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b903aa374145198a6a169c1da9b68a', 'request_id': 'req-e7617f1a-53ac-4490-96c9-126e3ce1f99f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.492851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b903aa374145198a6a169c1da9b68a', 'request_id': 'req-e7617f1a-53ac-4490-96c9-126e3ce1f99f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.500214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b903aa374145198a6a169c1da9b68a', 'request_id': 'req-e7617f1a-53ac-4490-96c9-126e3ce1f99f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.511918 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] The token cache is being invalidate because project 19b903aa374145198a6a169c1da9b68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:52.512225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.512969 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.514547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1370/2776] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:52 2022] DELETE /identity/v3/projects/19b903aa374145198a6a169c1da9b68a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:52.518604 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc15eb-5989-4d42-9ff2-76c8b33b39bb service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:52.528573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc15eb-5989-4d42-9ff2-76c8b33b39bb service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:52.607897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:52.608880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:52.609320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:52.609788 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] PATH_INFO: `/v3/users/cf2e21d0feb14168b3a97f97b031307d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:52.611119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2e21d0feb14168b3a97f97b031307d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:52.613202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:52.695063 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2e21d0feb14168b3a97f97b031307d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.719510 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2e21d0feb14168b3a97f97b031307d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.720725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2e21d0feb14168b3a97f97b031307d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.734702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2e21d0feb14168b3a97f97b031307d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.736171 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2e21d0feb14168b3a97f97b031307d'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:52.762467 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1407/2777] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:52 2022] DELETE /identity/v3/users/cf2e21d0feb14168b3a97f97b031307d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:53.286782 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:53.288719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:53.308857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7617f1a-53ac-4490-96c9-126e3ce1f99f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:53.327017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:53.394124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:53.394848 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:53.395067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:53.395340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] PATH_INFO: `/v3/users/c01f2e5585ba41e8b3947177030a4759` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:53.396493 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01f2e5585ba41e8b3947177030a4759)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:53.398417 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:53.455362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01f2e5585ba41e8b3947177030a4759'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.456170 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01f2e5585ba41e8b3947177030a4759'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.477192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01f2e5585ba41e8b3947177030a4759'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.490774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01f2e5585ba41e8b3947177030a4759'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.490774 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-6383ba2f-dd93-4e54-89c8-776805d3dfef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01f2e5585ba41e8b3947177030a4759'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.491689 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:53.493520 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:53.512338 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1371/2778] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:53 2022] DELETE /identity/v3/users/c01f2e5585ba41e8b3947177030a4759 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:53.518251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2fa1-963c-419c-a369-ce1de5de2007 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:53.577118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:53.603665 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:53.604783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:53.605140 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:53.605533 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] PATH_INFO: `/v3/projects/93eb98a31e524dc2b9a36623e44124f6` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:53.606925 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93eb98a31e524dc2b9a36623e44124f6)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:53.608961 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:53.671227 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93eb98a31e524dc2b9a36623e44124f6', 'request_id': 'req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.680846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93eb98a31e524dc2b9a36623e44124f6', 'request_id': 'req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.693725 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93eb98a31e524dc2b9a36623e44124f6', 'request_id': 'req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.708230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] The token cache is being invalidate because project 93eb98a31e524dc2b9a36623e44124f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:53.708727 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.709596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.711306 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1408/2779] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:53 2022] DELETE /identity/v3/projects/93eb98a31e524dc2b9a36623e44124f6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:53.718458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56351b8e-de28-479f-9fc2-6a6ed9b856ac None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:53.718783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56351b8e-de28-479f-9fc2-6a6ed9b856ac None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:53.719237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56351b8e-de28-479f-9fc2-6a6ed9b856ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:53.744216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:53.745933 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-56351b8e-de28-479f-9fc2-6a6ed9b856ac None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:53.747418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:53.748411 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-56351b8e-de28-479f-9fc2-6a6ed9b856ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:53.851332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1372/2780] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:53.860695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21fbe-4d8d-401e-adc8-d2ed63f62725 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:53.861158 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21fbe-4d8d-401e-adc8-d2ed63f62725 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:53.861574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed21fbe-4d8d-401e-adc8-d2ed63f62725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:53.872307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b798ef-b9ce-48b9-8558-695aa6bf9b7f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:53.880038 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:53.880749 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:53.881030 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:53.881390 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] PATH_INFO: `/v3/projects/6bfd0cbb9ec84d70898a6ddc48f7a52a` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:53.882966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfd0cbb9ec84d70898a6ddc48f7a52a)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:53.884739 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:53.886862 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-7ed21fbe-4d8d-401e-adc8-d2ed63f62725 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:53.888685 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-7ed21fbe-4d8d-401e-adc8-d2ed63f62725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:53.904211 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1373/2781] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:53.910418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed21fbe-4d8d-401e-adc8-d2ed63f62725 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:53.926221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed21fbe-4d8d-401e-adc8-d2ed63f62725 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:53.931469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a0961-359e-4303-9fbc-d52582d321e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:53.932107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a0961-359e-4303-9fbc-d52582d321e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:53.932389 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a0961-359e-4303-9fbc-d52582d321e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:53.932776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a0961-359e-4303-9fbc-d52582d321e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:53.934249 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a0961-359e-4303-9fbc-d52582d321e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:48:53.934548 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a0961-359e-4303-9fbc-d52582d321e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:53.936365 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a0961-359e-4303-9fbc-d52582d321e6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:53.955021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1374/2782] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:48:53.957325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a0961-359e-4303-9fbc-d52582d321e6 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:53.960614 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfd0cbb9ec84d70898a6ddc48f7a52a', 'request_id': 'req-8563eb0f-8e8d-4405-aef9-df3057237492'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.966926 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfd0cbb9ec84d70898a6ddc48f7a52a', 'request_id': 'req-8563eb0f-8e8d-4405-aef9-df3057237492'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.970089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a0961-359e-4303-9fbc-d52582d321e6 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:53.977436 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfd0cbb9ec84d70898a6ddc48f7a52a', 'request_id': 'req-8563eb0f-8e8d-4405-aef9-df3057237492'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.987491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:53.997822 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] The token cache is being invalidate because project 6bfd0cbb9ec84d70898a6ddc48f7a52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:53.998251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:53.999198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:54.001424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1409/2783] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:53 2022] DELETE /identity/v3/projects/6bfd0cbb9ec84d70898a6ddc48f7a52a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:54.058532 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101e165-bf96-4cfc-bd26-0f6bcd7cea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:54.059801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101e165-bf96-4cfc-bd26-0f6bcd7cea74 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.060133 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101e165-bf96-4cfc-bd26-0f6bcd7cea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.060440 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101e165-bf96-4cfc-bd26-0f6bcd7cea74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.061108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101e165-bf96-4cfc-bd26-0f6bcd7cea74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:54.063237 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101e165-bf96-4cfc-bd26-0f6bcd7cea74 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:54.095709 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1375/2784] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:53 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:54.100588 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:54.102162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:54.117103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563eb0f-8e8d-4405-aef9-df3057237492 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:54.122154 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:54.219087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310af1ac-4a95-43bd-8151-1b8d3f490203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:54.220052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310af1ac-4a95-43bd-8151-1b8d3f490203 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.220477 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310af1ac-4a95-43bd-8151-1b8d3f490203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.220891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310af1ac-4a95-43bd-8151-1b8d3f490203 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.221922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310af1ac-4a95-43bd-8151-1b8d3f490203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:54.225234 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310af1ac-4a95-43bd-8151-1b8d3f490203 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:54.270816 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1410/2785] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:54 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:54.272391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101e165-bf96-4cfc-bd26-0f6bcd7cea74 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:54.285212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101e165-bf96-4cfc-bd26-0f6bcd7cea74 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:54.292404 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087274c-add0-47ee-9ced-9765946cbf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:54.293958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087274c-add0-47ee-9ced-9765946cbf30 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.294640 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087274c-add0-47ee-9ced-9765946cbf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.295200 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087274c-add0-47ee-9ced-9765946cbf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.296340 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087274c-add0-47ee-9ced-9765946cbf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:54.299037 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087274c-add0-47ee-9ced-9765946cbf30 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:54.316478 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1376/2786] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:54.320949 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310af1ac-4a95-43bd-8151-1b8d3f490203 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:54.333137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310af1ac-4a95-43bd-8151-1b8d3f490203 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:54.338138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717ef06-cc45-44b0-8ecf-865a14334e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:54.338742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717ef06-cc45-44b0-8ecf-865a14334e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.339041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717ef06-cc45-44b0-8ecf-865a14334e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.339318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717ef06-cc45-44b0-8ecf-865a14334e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.340507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717ef06-cc45-44b0-8ecf-865a14334e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:54.342107 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717ef06-cc45-44b0-8ecf-865a14334e7f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:54.352832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1411/2787] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:48:54.358216 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087274c-add0-47ee-9ced-9765946cbf30 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:54.369057 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087274c-add0-47ee-9ced-9765946cbf30 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:54.374540 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db7fd9-c519-4c3f-a2a5-e6b1a636cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:54.375300 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7fd9-c519-4c3f-a2a5-e6b1a636cb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.375693 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7fd9-c519-4c3f-a2a5-e6b1a636cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.376015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7fd9-c519-4c3f-a2a5-e6b1a636cb0a admin admin] PATH_INFO: `/v3/projects/fba2864aa9404bb08303d36c7a9545ad/users/5cd69da293ae4f65985ec1a08ae4c5af/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.396285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db7fd9-c519-4c3f-a2a5-e6b1a636cb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba2864aa9404bb08303d36c7a9545ad, user_id=5cd69da293ae4f65985ec1a08ae4c5af, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:54.401671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db7fd9-c519-4c3f-a2a5-e6b1a636cb0a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:54.424586 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1377/2788] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:54 2022] PUT /identity/v3/projects/fba2864aa9404bb08303d36c7a9545ad/users/5cd69da293ae4f65985ec1a08ae4c5af/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:54.438216 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae861c-3bd2-4db1-9c8c-713c47db8923 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.438565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae861c-3bd2-4db1-9c8c-713c47db8923 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.439036 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae861c-3bd2-4db1-9c8c-713c47db8923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.480844 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-39ae861c-3bd2-4db1-9c8c-713c47db8923 None None] MFA Rules not processed for user `5cd69da293ae4f65985ec1a08ae4c5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:54.483314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-39ae861c-3bd2-4db1-9c8c-713c47db8923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:54.579372 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1412/2789] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:54.585521 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db7fd9-c519-4c3f-a2a5-e6b1a636cb0a admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:54.667702 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db7fd9-c519-4c3f-a2a5-e6b1a636cb0a admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:54.673463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae05e5-18c9-45fb-8b78-a4baf04e8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:54.674087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae05e5-18c9-45fb-8b78-a4baf04e8534 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.674372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae05e5-18c9-45fb-8b78-a4baf04e8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.674648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae05e5-18c9-45fb-8b78-a4baf04e8534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.675321 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae05e5-18c9-45fb-8b78-a4baf04e8534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:54.677335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae05e5-18c9-45fb-8b78-a4baf04e8534 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:54.722108 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1378/2790] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:54 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:54.727164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae861c-3bd2-4db1-9c8c-713c47db8923 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:54.740701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae861c-3bd2-4db1-9c8c-713c47db8923 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:54.812174 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45864ab3-4cc2-4079-87c9-ed7cb4654ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:54.813007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45864ab3-4cc2-4079-87c9-ed7cb4654ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.813462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45864ab3-4cc2-4079-87c9-ed7cb4654ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.813793 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45864ab3-4cc2-4079-87c9-ed7cb4654ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.814459 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45864ab3-4cc2-4079-87c9-ed7cb4654ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:54.816458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45864ab3-4cc2-4079-87c9-ed7cb4654ce9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:54.841226 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1413/2791] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:54 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:54.845804 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae05e5-18c9-45fb-8b78-a4baf04e8534 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:54.858354 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae05e5-18c9-45fb-8b78-a4baf04e8534 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:54.864079 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fef36-f974-495c-a693-ccd0e9b9103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:54.864800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fef36-f974-495c-a693-ccd0e9b9103c admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.865180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fef36-f974-495c-a693-ccd0e9b9103c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.865572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fef36-f974-495c-a693-ccd0e9b9103c admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.866326 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fef36-f974-495c-a693-ccd0e9b9103c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:54.868166 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fef36-f974-495c-a693-ccd0e9b9103c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:54.881030 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1379/2792] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:48:54.885455 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45864ab3-4cc2-4079-87c9-ed7cb4654ce9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:54.892922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:54.897701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45864ab3-4cc2-4079-87c9-ed7cb4654ce9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:54.906894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e01ef-b18a-4038-b0ac-9cedc05997ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:54.907817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e01ef-b18a-4038-b0ac-9cedc05997ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:54.908141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e01ef-b18a-4038-b0ac-9cedc05997ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:54.908471 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e01ef-b18a-4038-b0ac-9cedc05997ee admin admin] PATH_INFO: `/v3/projects/293ff003c238425ca1b44e6cc63e1b7d/users/ece09a3294b549a2b6ea89bf6e27e6b9/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:54.925960 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e01ef-b18a-4038-b0ac-9cedc05997ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=293ff003c238425ca1b44e6cc63e1b7d, user_id=ece09a3294b549a2b6ea89bf6e27e6b9, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:54.928669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e01ef-b18a-4038-b0ac-9cedc05997ee admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:54.943956 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1414/2793] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:54 2022] PUT /identity/v3/projects/293ff003c238425ca1b44e6cc63e1b7d/users/ece09a3294b549a2b6ea89bf6e27e6b9/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:54.948590 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fef36-f974-495c-a693-ccd0e9b9103c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:54.961323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fef36-f974-495c-a693-ccd0e9b9103c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:55.004334 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:55.031988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfaca3-76ca-410c-9d98-0649dad812c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:55.032609 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfaca3-76ca-410c-9d98-0649dad812c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:55.032893 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfaca3-76ca-410c-9d98-0649dad812c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:55.033162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfaca3-76ca-410c-9d98-0649dad812c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:55.033822 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfaca3-76ca-410c-9d98-0649dad812c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:55.035544 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfaca3-76ca-410c-9d98-0649dad812c1 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:55.046323 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1380/2794] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:48:55.050717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e01ef-b18a-4038-b0ac-9cedc05997ee admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:55.061507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e01ef-b18a-4038-b0ac-9cedc05997ee admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:55.066690 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d1845-54bf-40ea-a735-954f2c765680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:55.067573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d1845-54bf-40ea-a735-954f2c765680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:55.067876 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d1845-54bf-40ea-a735-954f2c765680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:55.068177 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d1845-54bf-40ea-a735-954f2c765680 admin admin] PATH_INFO: `/v3/projects/293ff003c238425ca1b44e6cc63e1b7d/users/ece09a3294b549a2b6ea89bf6e27e6b9/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:55.070209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d1845-54bf-40ea-a735-954f2c765680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293ff003c238425ca1b44e6cc63e1b7d, user_id=ece09a3294b549a2b6ea89bf6e27e6b9, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:55.072988 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d1845-54bf-40ea-a735-954f2c765680 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:55.085096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1415/2795] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:55 2022] PUT /identity/v3/projects/293ff003c238425ca1b44e6cc63e1b7d/users/ece09a3294b549a2b6ea89bf6e27e6b9/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:55.097628 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9bc6c-f2ba-45fa-9c60-67fdee1a8f48 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:55.098050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9bc6c-f2ba-45fa-9c60-67fdee1a8f48 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:55.098456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9bc6c-f2ba-45fa-9c60-67fdee1a8f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:55.128202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-65a9bc6c-f2ba-45fa-9c60-67fdee1a8f48 None None] MFA Rules not processed for user `ece09a3294b549a2b6ea89bf6e27e6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:55.129421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-65a9bc6c-f2ba-45fa-9c60-67fdee1a8f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:55.205731 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1381/2796] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:48:55.217692 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d1845-54bf-40ea-a735-954f2c765680 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:55.219425 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-466d1845-54bf-40ea-a735-954f2c765680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:55.312770 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d1845-54bf-40ea-a735-954f2c765680 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:55.316780 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85443d5-dba6-4b3b-ac9d-fc240cd003a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:55.317388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85443d5-dba6-4b3b-ac9d-fc240cd003a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:55.317747 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85443d5-dba6-4b3b-ac9d-fc240cd003a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:55.318024 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85443d5-dba6-4b3b-ac9d-fc240cd003a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:55.328695 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85443d5-dba6-4b3b-ac9d-fc240cd003a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:55.330141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85443d5-dba6-4b3b-ac9d-fc240cd003a5 service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:55.340319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1416/2797] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:55.871911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9bc6c-f2ba-45fa-9c60-67fdee1a8f48 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:55.937847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9bc6c-f2ba-45fa-9c60-67fdee1a8f48 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:55.942957 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:55.943615 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:55.943887 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:55.944273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] PATH_INFO: `/v3/users/5cd69da293ae4f65985ec1a08ae4c5af` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:55.945393 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd69da293ae4f65985ec1a08ae4c5af)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:55.947412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:56.009469 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd69da293ae4f65985ec1a08ae4c5af'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.010227 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd69da293ae4f65985ec1a08ae4c5af'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.023800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:56.028124 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd69da293ae4f65985ec1a08ae4c5af'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.038563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd69da293ae4f65985ec1a08ae4c5af'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.039403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd69da293ae4f65985ec1a08ae4c5af'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.054048 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1382/2798] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:55 2022] DELETE /identity/v3/users/5cd69da293ae4f65985ec1a08ae4c5af => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:56.059209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430510b-0050-4865-999c-4b1b238327f7 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:56.060043 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430510b-0050-4865-999c-4b1b238327f7 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:56.060212 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430510b-0050-4865-999c-4b1b238327f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:56.080827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-a430510b-0050-4865-999c-4b1b238327f7 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:56.082069 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a430510b-0050-4865-999c-4b1b238327f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:56.143677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1417/2799] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:56.154654 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:56.156445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:56.214630 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5348fe-52fa-497d-befa-7b51adadaddf admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:56.218881 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98241cf8-30d4-4216-8c71-6caa95b96795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:56.219524 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98241cf8-30d4-4216-8c71-6caa95b96795 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:56.219801 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98241cf8-30d4-4216-8c71-6caa95b96795 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:56.220069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98241cf8-30d4-4216-8c71-6caa95b96795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:56.229968 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98241cf8-30d4-4216-8c71-6caa95b96795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:56.232097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98241cf8-30d4-4216-8c71-6caa95b96795 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:56.241956 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1383/2800] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:48:56.525490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430510b-0050-4865-999c-4b1b238327f7 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:56.527984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-a430510b-0050-4865-999c-4b1b238327f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:56.542558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430510b-0050-4865-999c-4b1b238327f7 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:56.547517 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:56.548181 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:56.548462 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:56.549502 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] PATH_INFO: `/v3/projects/fba2864aa9404bb08303d36c7a9545ad` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:56.550089 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba2864aa9404bb08303d36c7a9545ad)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:56.552066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:56.604215 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:56.608803 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba2864aa9404bb08303d36c7a9545ad', 'request_id': 'req-8a4fe6a5-328b-4c16-a6c1-9d5919080840'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.616702 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba2864aa9404bb08303d36c7a9545ad', 'request_id': 'req-8a4fe6a5-328b-4c16-a6c1-9d5919080840'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.625627 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba2864aa9404bb08303d36c7a9545ad', 'request_id': 'req-8a4fe6a5-328b-4c16-a6c1-9d5919080840'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.645052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] The token cache is being invalidate because project fba2864aa9404bb08303d36c7a9545ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:56.645524 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.646399 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.647963 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1418/2801] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:56 2022] DELETE /identity/v3/projects/fba2864aa9404bb08303d36c7a9545ad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:56.652710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98241cf8-30d4-4216-8c71-6caa95b96795 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:56.663839 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98241cf8-30d4-4216-8c71-6caa95b96795 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:56.731652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:56.732649 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:56.732988 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:56.733370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] PATH_INFO: `/v3/users/ece09a3294b549a2b6ea89bf6e27e6b9` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:56.735084 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece09a3294b549a2b6ea89bf6e27e6b9)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:56.737439 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:56.812268 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece09a3294b549a2b6ea89bf6e27e6b9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.813033 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece09a3294b549a2b6ea89bf6e27e6b9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.827534 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece09a3294b549a2b6ea89bf6e27e6b9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.838189 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece09a3294b549a2b6ea89bf6e27e6b9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.839025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-017d71e8-3d3f-41f1-9c1e-4ece595e053c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece09a3294b549a2b6ea89bf6e27e6b9'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:56.850260 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:56.854499 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1384/2802] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:48:56 2022] DELETE /identity/v3/users/ece09a3294b549a2b6ea89bf6e27e6b9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:57.152236 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:57.154041 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:57.173279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe6a5-328b-4c16-a6c1-9d5919080840 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:57.248274 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:57.249051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.249507 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.249894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] PATH_INFO: `/v3/projects/293ff003c238425ca1b44e6cc63e1b7d` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.251528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293ff003c238425ca1b44e6cc63e1b7d)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:57.254579 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:57.309874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293ff003c238425ca1b44e6cc63e1b7d', 'request_id': 'req-c84353e5-f89a-48cb-b87d-1d2c5521ad62'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:57.316206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293ff003c238425ca1b44e6cc63e1b7d', 'request_id': 'req-c84353e5-f89a-48cb-b87d-1d2c5521ad62'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:57.324519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293ff003c238425ca1b44e6cc63e1b7d', 'request_id': 'req-c84353e5-f89a-48cb-b87d-1d2c5521ad62'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:57.338056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] The token cache is being invalidate because project 293ff003c238425ca1b44e6cc63e1b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:48:57.338558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:57.339683 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-c84353e5-f89a-48cb-b87d-1d2c5521ad62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:48:57.342729 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1419/2803] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:48:57 2022] DELETE /identity/v3/projects/293ff003c238425ca1b44e6cc63e1b7d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:57.350510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7118-001c-4f88-911e-ca183d276729 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.351137 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7118-001c-4f88-911e-ca183d276729 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.351533 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7118-001c-4f88-911e-ca183d276729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.381083 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b49e7118-001c-4f88-911e-ca183d276729 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:57.382872 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b49e7118-001c-4f88-911e-ca183d276729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:57.472739 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1385/2804] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:57.481980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acde3c-9604-404e-bebf-7c04a13fd228 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.482267 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acde3c-9604-404e-bebf-7c04a13fd228 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.482545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acde3c-9604-404e-bebf-7c04a13fd228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.502752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c2acde3c-9604-404e-bebf-7c04a13fd228 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:57.504175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c2acde3c-9604-404e-bebf-7c04a13fd228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:57.512616 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1420/2805] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:57.516994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7118-001c-4f88-911e-ca183d276729 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:57.528399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7118-001c-4f88-911e-ca183d276729 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:57.533549 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6172fa-4fbc-4376-bafc-1f646568be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:57.534272 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6172fa-4fbc-4376-bafc-1f646568be30 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.534561 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6172fa-4fbc-4376-bafc-1f646568be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.534840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6172fa-4fbc-4376-bafc-1f646568be30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.535528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6172fa-4fbc-4376-bafc-1f646568be30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:48:57.535835 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6172fa-4fbc-4376-bafc-1f646568be30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:57.537448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6172fa-4fbc-4376-bafc-1f646568be30 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:57.550575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1386/2806] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:48:57.556454 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acde3c-9604-404e-bebf-7c04a13fd228 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:57.567138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acde3c-9604-404e-bebf-7c04a13fd228 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:57.573883 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76362d-f5a1-4274-89da-d358ebcbb496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:57.574976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76362d-f5a1-4274-89da-d358ebcbb496 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.575498 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76362d-f5a1-4274-89da-d358ebcbb496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.575905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76362d-f5a1-4274-89da-d358ebcbb496 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.576860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76362d-f5a1-4274-89da-d358ebcbb496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:57.579996 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76362d-f5a1-4274-89da-d358ebcbb496 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:57.618110 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1421/2807] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:57 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:57.624138 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6172fa-4fbc-4376-bafc-1f646568be30 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:57.639592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6172fa-4fbc-4376-bafc-1f646568be30 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:57.725093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb183-ae9f-41b5-9200-9725f8691ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:57.726006 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb183-ae9f-41b5-9200-9725f8691ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.726433 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb183-ae9f-41b5-9200-9725f8691ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.726882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb183-ae9f-41b5-9200-9725f8691ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.727886 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfb183-ae9f-41b5-9200-9725f8691ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:57.731650 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfb183-ae9f-41b5-9200-9725f8691ac6 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:57.758495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1387/2808] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:57 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:57.765670 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76362d-f5a1-4274-89da-d358ebcbb496 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:57.784860 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76362d-f5a1-4274-89da-d358ebcbb496 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:57.792751 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a15d63-3c33-4906-b6a5-37eb01cab460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:57.793794 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15d63-3c33-4906-b6a5-37eb01cab460 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.794273 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15d63-3c33-4906-b6a5-37eb01cab460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.794800 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15d63-3c33-4906-b6a5-37eb01cab460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.796033 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a15d63-3c33-4906-b6a5-37eb01cab460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:57.799108 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a15d63-3c33-4906-b6a5-37eb01cab460 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:57.818182 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1422/2809] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:57.819594 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb183-ae9f-41b5-9200-9725f8691ac6 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:57.833644 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb183-ae9f-41b5-9200-9725f8691ac6 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:57.839394 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8db6d9-a518-484b-9e8d-06f0a8c1524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:57.840085 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8db6d9-a518-484b-9e8d-06f0a8c1524e admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.840370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8db6d9-a518-484b-9e8d-06f0a8c1524e admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.841250 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8db6d9-a518-484b-9e8d-06f0a8c1524e admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.841911 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8db6d9-a518-484b-9e8d-06f0a8c1524e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:57.843719 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8db6d9-a518-484b-9e8d-06f0a8c1524e admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:57.855764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1388/2810] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:57.860197 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a15d63-3c33-4906-b6a5-37eb01cab460 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:57.872487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a15d63-3c33-4906-b6a5-37eb01cab460 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:57.879361 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4f0ab-7187-4e3c-a56d-7e039d772b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:57.880270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f0ab-7187-4e3c-a56d-7e039d772b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.880718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f0ab-7187-4e3c-a56d-7e039d772b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.881156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f0ab-7187-4e3c-a56d-7e039d772b02 admin admin] PATH_INFO: `/v3/projects/7f7d2a9c6ad3484f86b393bbc5ed96c2/users/bce87703ef474543be9f7bc1be46112f/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.903677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4f0ab-7187-4e3c-a56d-7e039d772b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7d2a9c6ad3484f86b393bbc5ed96c2, user_id=bce87703ef474543be9f7bc1be46112f, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:57.907325 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4f0ab-7187-4e3c-a56d-7e039d772b02 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:57.921156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:57.930341 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1423/2811] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:57 2022] PUT /identity/v3/projects/7f7d2a9c6ad3484f86b393bbc5ed96c2/users/bce87703ef474543be9f7bc1be46112f/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:48:57.943682 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcc90b-fa4b-4f71-b9d7-14ff6c556271 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:57.944106 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcc90b-fa4b-4f71-b9d7-14ff6c556271 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:57.944509 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcc90b-fa4b-4f71-b9d7-14ff6c556271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:57.991710 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-1adcc90b-fa4b-4f71-b9d7-14ff6c556271 None None] MFA Rules not processed for user `bce87703ef474543be9f7bc1be46112f`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:57.993720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-1adcc90b-fa4b-4f71-b9d7-14ff6c556271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:58.085472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:58.100352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1389/2812] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:58.105646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4f0ab-7187-4e3c-a56d-7e039d772b02 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:58.193998 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4f0ab-7187-4e3c-a56d-7e039d772b02 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:58.202249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4611b-e6cd-4b29-9fd4-2d3a50aae5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:58.203085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4611b-e6cd-4b29-9fd4-2d3a50aae5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:58.203558 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4611b-e6cd-4b29-9fd4-2d3a50aae5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:58.204009 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4611b-e6cd-4b29-9fd4-2d3a50aae5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:58.205087 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4611b-e6cd-4b29-9fd4-2d3a50aae5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:58.208621 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4611b-e6cd-4b29-9fd4-2d3a50aae5ec admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:58.254619 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1424/2813] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:48:58 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:48:58.256403 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcc90b-fa4b-4f71-b9d7-14ff6c556271 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:58.272016 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcc90b-fa4b-4f71-b9d7-14ff6c556271 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:58.375236 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6f2ce-90b0-4ca6-a2e0-c471bc67e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:58.376197 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6f2ce-90b0-4ca6-a2e0-c471bc67e32f admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:58.376635 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6f2ce-90b0-4ca6-a2e0-c471bc67e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:58.377087 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6f2ce-90b0-4ca6-a2e0-c471bc67e32f admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:58.378178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6f2ce-90b0-4ca6-a2e0-c471bc67e32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:58.382019 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6f2ce-90b0-4ca6-a2e0-c471bc67e32f admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:58.423474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1390/2814] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:48:58 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:48:58.427705 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4611b-e6cd-4b29-9fd4-2d3a50aae5ec admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:58.441330 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4611b-e6cd-4b29-9fd4-2d3a50aae5ec admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:58.446964 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ce049-d53f-4476-bbde-72300f5880d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:58.447585 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ce049-d53f-4476-bbde-72300f5880d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:58.447867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ce049-d53f-4476-bbde-72300f5880d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:58.448143 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ce049-d53f-4476-bbde-72300f5880d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:58.448807 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ce049-d53f-4476-bbde-72300f5880d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:58.451008 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ce049-d53f-4476-bbde-72300f5880d9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:58.463229 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1425/2815] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:58.467928 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6f2ce-90b0-4ca6-a2e0-c471bc67e32f admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:58.479205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6f2ce-90b0-4ca6-a2e0-c471bc67e32f admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:58.486315 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d8ebb-5207-4d77-a6d3-72314052809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:58.487528 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d8ebb-5207-4d77-a6d3-72314052809b admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:58.488069 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d8ebb-5207-4d77-a6d3-72314052809b admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:58.488568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d8ebb-5207-4d77-a6d3-72314052809b admin admin] PATH_INFO: `/v3/projects/fdda107285574d44ac35e17be86ee54e/users/ad9dbfbd9691412bb12d11b24725b172/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:58.518653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d8ebb-5207-4d77-a6d3-72314052809b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdda107285574d44ac35e17be86ee54e, user_id=ad9dbfbd9691412bb12d11b24725b172, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:58.524510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d8ebb-5207-4d77-a6d3-72314052809b admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:58.545487 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1391/2816] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:58 2022] PUT /identity/v3/projects/fdda107285574d44ac35e17be86ee54e/users/ad9dbfbd9691412bb12d11b24725b172/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:58.550706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ce049-d53f-4476-bbde-72300f5880d9 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:58.562927 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ce049-d53f-4476-bbde-72300f5880d9 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:58.621687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf559e02-3199-4dac-8abd-e388cb5e701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:58.622276 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559e02-3199-4dac-8abd-e388cb5e701c admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:58.622629 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559e02-3199-4dac-8abd-e388cb5e701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:58.622839 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559e02-3199-4dac-8abd-e388cb5e701c admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:58.623573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf559e02-3199-4dac-8abd-e388cb5e701c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:58.625351 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf559e02-3199-4dac-8abd-e388cb5e701c admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:58.637581 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1426/2817] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:48:58.644465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d8ebb-5207-4d77-a6d3-72314052809b admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:58.657885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d8ebb-5207-4d77-a6d3-72314052809b admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:58.662500 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d188f-05e6-4b02-afa4-968bc612a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:58.663195 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d188f-05e6-4b02-afa4-968bc612a2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:58.663617 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d188f-05e6-4b02-afa4-968bc612a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:58.663873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d188f-05e6-4b02-afa4-968bc612a2ed admin admin] PATH_INFO: `/v3/projects/fdda107285574d44ac35e17be86ee54e/users/ad9dbfbd9691412bb12d11b24725b172/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:58.665859 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d188f-05e6-4b02-afa4-968bc612a2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdda107285574d44ac35e17be86ee54e, user_id=ad9dbfbd9691412bb12d11b24725b172, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:58.668575 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d188f-05e6-4b02-afa4-968bc612a2ed admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:58.679944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1392/2818] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:48:58 2022] PUT /identity/v3/projects/fdda107285574d44ac35e17be86ee54e/users/ad9dbfbd9691412bb12d11b24725b172/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:48:58.691427 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbb084-1b29-4ce5-842f-aa730621ff27 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:58.691718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbb084-1b29-4ce5-842f-aa730621ff27 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:58.691999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbb084-1b29-4ce5-842f-aa730621ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:58.721792 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-44dbb084-1b29-4ce5-842f-aa730621ff27 None None] MFA Rules not processed for user `ad9dbfbd9691412bb12d11b24725b172`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:48:58.723052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-44dbb084-1b29-4ce5-842f-aa730621ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:58.789778 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:48:58.807090 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1427/2819] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:48:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:48:58.819472 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d188f-05e6-4b02-afa4-968bc612a2ed admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:58.821895 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-515d188f-05e6-4b02-afa4-968bc612a2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:58.887648 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d188f-05e6-4b02-afa4-968bc612a2ed admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:58.891536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3793f-b918-4b80-a39f-a79547e363d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:58.892214 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3793f-b918-4b80-a39f-a79547e363d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:58.892611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3793f-b918-4b80-a39f-a79547e363d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:58.892847 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3793f-b918-4b80-a39f-a79547e363d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:58.903995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3793f-b918-4b80-a39f-a79547e363d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:58.905852 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3793f-b918-4b80-a39f-a79547e363d4 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:58.915967 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1393/2820] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:48:58.969852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbb084-1b29-4ce5-842f-aa730621ff27 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:48:58.971776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-44dbb084-1b29-4ce5-842f-aa730621ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:48:58.990385 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbb084-1b29-4ce5-842f-aa730621ff27 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:48:58.995783 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118499cd-e2a4-460d-849b-8b06537d62de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:48:58.996696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118499cd-e2a4-460d-849b-8b06537d62de service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:48:58.997128 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118499cd-e2a4-460d-849b-8b06537d62de service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:48:58.997565 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118499cd-e2a4-460d-849b-8b06537d62de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:48:59.064164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118499cd-e2a4-460d-849b-8b06537d62de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:48:59.065607 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118499cd-e2a4-460d-849b-8b06537d62de service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:48:59.075655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1428/2821] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:48:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:02.814597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3793f-b918-4b80-a39f-a79547e363d4 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:02.874378 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:02.889001 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3793f-b918-4b80-a39f-a79547e363d4 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:02.894129 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:02.894751 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:02.895060 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:02.895335 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] PATH_INFO: `/v3/users/bce87703ef474543be9f7bc1be46112f` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:02.896457 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce87703ef474543be9f7bc1be46112f)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:02.898353 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:02.946863 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce87703ef474543be9f7bc1be46112f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:02.947889 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce87703ef474543be9f7bc1be46112f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:02.961878 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce87703ef474543be9f7bc1be46112f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:02.969836 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce87703ef474543be9f7bc1be46112f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:02.970587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce87703ef474543be9f7bc1be46112f'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:02.985483 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1394/2822] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:02 2022] DELETE /identity/v3/users/bce87703ef474543be9f7bc1be46112f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:49:02.991811 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ee69-286e-49d6-b2fa-d37580e30a07 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:02.992408 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ee69-286e-49d6-b2fa-d37580e30a07 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:02.992697 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ee69-286e-49d6-b2fa-d37580e30a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:03.019261 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-5634ee69-286e-49d6-b2fa-d37580e30a07 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:03.020669 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5634ee69-286e-49d6-b2fa-d37580e30a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:03.082379 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1429/2823] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:03.092642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:03.094286 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:03.154783 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68fdbf-31b8-4289-b71e-fc72c3162bb0 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:03.158868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45ac90-8dec-4567-9e57-ba9d349af3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:03.159503 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45ac90-8dec-4567-9e57-ba9d349af3ec service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:03.159788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45ac90-8dec-4567-9e57-ba9d349af3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:03.160065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45ac90-8dec-4567-9e57-ba9d349af3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:03.169787 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45ac90-8dec-4567-9e57-ba9d349af3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:03.171273 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45ac90-8dec-4567-9e57-ba9d349af3ec service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:03.183621 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1395/2824] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:03.517155 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634ee69-286e-49d6-b2fa-d37580e30a07 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:03.519220 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-5634ee69-286e-49d6-b2fa-d37580e30a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:03.539574 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634ee69-286e-49d6-b2fa-d37580e30a07 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:03.547680 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:03.548403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:03.548703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:03.548970 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] PATH_INFO: `/v3/projects/7f7d2a9c6ad3484f86b393bbc5ed96c2` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:03.550200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7d2a9c6ad3484f86b393bbc5ed96c2)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:03.552976 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:03.604319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7d2a9c6ad3484f86b393bbc5ed96c2', 'request_id': 'req-3d00d078-8af6-438d-94e0-d4695ef09042'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.610358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7d2a9c6ad3484f86b393bbc5ed96c2', 'request_id': 'req-3d00d078-8af6-438d-94e0-d4695ef09042'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.619905 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7d2a9c6ad3484f86b393bbc5ed96c2', 'request_id': 'req-3d00d078-8af6-438d-94e0-d4695ef09042'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.633534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] The token cache is being invalidate because project 7f7d2a9c6ad3484f86b393bbc5ed96c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:03.633984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.634573 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.636456 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1430/2825] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:03 2022] DELETE /identity/v3/projects/7f7d2a9c6ad3484f86b393bbc5ed96c2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:03.641305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45ac90-8dec-4567-9e57-ba9d349af3ec service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:03.653082 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45ac90-8dec-4567-9e57-ba9d349af3ec service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:03.717592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:03.718285 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:03.718568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:03.718846 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] PATH_INFO: `/v3/users/ad9dbfbd9691412bb12d11b24725b172` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:03.720068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9dbfbd9691412bb12d11b24725b172)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:03.722075 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:03.739358 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:03.778818 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9dbfbd9691412bb12d11b24725b172'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.779597 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9dbfbd9691412bb12d11b24725b172'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.793449 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9dbfbd9691412bb12d11b24725b172'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.804021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9dbfbd9691412bb12d11b24725b172'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.805276 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-938e19ea-182b-487e-8691-7ff447990a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9dbfbd9691412bb12d11b24725b172'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:03.819436 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1396/2826] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:03 2022] DELETE /identity/v3/users/ad9dbfbd9691412bb12d11b24725b172 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:04.120424 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:04.122403 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:04.137609 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00d078-8af6-438d-94e0-d4695ef09042 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:04.158999 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:04.210666 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:04.211334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.211617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.211893 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] PATH_INFO: `/v3/projects/fdda107285574d44ac35e17be86ee54e` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.213028 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdda107285574d44ac35e17be86ee54e)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:04.214965 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:04.266575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdda107285574d44ac35e17be86ee54e', 'request_id': 'req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:04.272194 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdda107285574d44ac35e17be86ee54e', 'request_id': 'req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:04.281076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdda107285574d44ac35e17be86ee54e', 'request_id': 'req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:04.292923 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] The token cache is being invalidate because project fdda107285574d44ac35e17be86ee54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:04.293210 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:04.294211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be9ba72f-1b2e-46ac-b6d8-7d69312a5845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:04.295750 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1431/2827] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:04 2022] DELETE /identity/v3/projects/fdda107285574d44ac35e17be86ee54e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:04.300642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ad6b1-73c4-4650-b040-018f210662b4 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.300930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ad6b1-73c4-4650-b040-018f210662b4 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.301202 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ad6b1-73c4-4650-b040-018f210662b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.322631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-8d0ad6b1-73c4-4650-b040-018f210662b4 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:04.323934 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8d0ad6b1-73c4-4650-b040-018f210662b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:04.388407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1397/2828] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:04.396076 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d15ed-d59f-4417-a520-f14ece883680 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.396364 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d15ed-d59f-4417-a520-f14ece883680 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.396650 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d15ed-d59f-4417-a520-f14ece883680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.417138 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-d24d15ed-d59f-4417-a520-f14ece883680 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:04.418371 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-d24d15ed-d59f-4417-a520-f14ece883680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:04.426492 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1432/2829] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:49:04.431109 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ad6b1-73c4-4650-b040-018f210662b4 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:04.441587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ad6b1-73c4-4650-b040-018f210662b4 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:04.446448 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db2b83-7ed7-4e2d-92fb-a77cd4b572a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:04.447130 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db2b83-7ed7-4e2d-92fb-a77cd4b572a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.447407 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db2b83-7ed7-4e2d-92fb-a77cd4b572a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.447676 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db2b83-7ed7-4e2d-92fb-a77cd4b572a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.448332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db2b83-7ed7-4e2d-92fb-a77cd4b572a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:49:04.448631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db2b83-7ed7-4e2d-92fb-a77cd4b572a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:04.450866 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db2b83-7ed7-4e2d-92fb-a77cd4b572a3 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:04.463092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1398/2830] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 15:49:04.467634 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d15ed-d59f-4417-a520-f14ece883680 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:04.477263 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d15ed-d59f-4417-a520-f14ece883680 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:04.483406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e84d5-e046-4cfd-b892-1f7c94885ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:04.484499 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e84d5-e046-4cfd-b892-1f7c94885ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.485169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e84d5-e046-4cfd-b892-1f7c94885ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.485169 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e84d5-e046-4cfd-b892-1f7c94885ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.485675 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e84d5-e046-4cfd-b892-1f7c94885ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:04.487605 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e84d5-e046-4cfd-b892-1f7c94885ba7 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:04.519150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1433/2831] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:49:04 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:04.523126 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db2b83-7ed7-4e2d-92fb-a77cd4b572a3 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:04.533965 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db2b83-7ed7-4e2d-92fb-a77cd4b572a3 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:04.615652 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a64f62-7395-4f08-bf51-39b74279ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:04.616442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a64f62-7395-4f08-bf51-39b74279ad87 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.616781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a64f62-7395-4f08-bf51-39b74279ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.616961 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a64f62-7395-4f08-bf51-39b74279ad87 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.617481 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a64f62-7395-4f08-bf51-39b74279ad87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:04.619850 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a64f62-7395-4f08-bf51-39b74279ad87 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:04.657051 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1399/2832] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:49:04 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:04.658622 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e84d5-e046-4cfd-b892-1f7c94885ba7 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:04.670131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e84d5-e046-4cfd-b892-1f7c94885ba7 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:04.674819 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7811b6-5903-4fec-8c2d-05f9ff44dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:04.675445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7811b6-5903-4fec-8c2d-05f9ff44dc31 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.675724 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7811b6-5903-4fec-8c2d-05f9ff44dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.675994 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7811b6-5903-4fec-8c2d-05f9ff44dc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.676633 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7811b6-5903-4fec-8c2d-05f9ff44dc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:04.678219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7811b6-5903-4fec-8c2d-05f9ff44dc31 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:04.689895 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1434/2833] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:49:04.694332 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a64f62-7395-4f08-bf51-39b74279ad87 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:04.708028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a64f62-7395-4f08-bf51-39b74279ad87 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:04.713333 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b415f99-cc7b-4e62-ada1-04c9a2623060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:04.713921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415f99-cc7b-4e62-ada1-04c9a2623060 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.714205 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415f99-cc7b-4e62-ada1-04c9a2623060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.714485 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415f99-cc7b-4e62-ada1-04c9a2623060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.715184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b415f99-cc7b-4e62-ada1-04c9a2623060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:04.716812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b415f99-cc7b-4e62-ada1-04c9a2623060 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:04.719445 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:04.733875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1400/2834] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:49:04.738007 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7811b6-5903-4fec-8c2d-05f9ff44dc31 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:04.749559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7811b6-5903-4fec-8c2d-05f9ff44dc31 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:04.754571 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025771d-cf45-4af8-bf2b-9389a800974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:04.755295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025771d-cf45-4af8-bf2b-9389a800974f admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.755575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025771d-cf45-4af8-bf2b-9389a800974f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.755852 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025771d-cf45-4af8-bf2b-9389a800974f admin admin] PATH_INFO: `/v3/projects/b8b9cec3f0cb45e59a9439aadfdb3081/users/29e6b3fca6794333913bdb880b0b5733/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.771334 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025771d-cf45-4af8-bf2b-9389a800974f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b9cec3f0cb45e59a9439aadfdb3081, user_id=29e6b3fca6794333913bdb880b0b5733, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:04.774250 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025771d-cf45-4af8-bf2b-9389a800974f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:04.800492 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1435/2835] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:49:04 2022] PUT /identity/v3/projects/b8b9cec3f0cb45e59a9439aadfdb3081/users/29e6b3fca6794333913bdb880b0b5733/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:04.815282 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41661-8ee3-4c3d-8b5c-ea970dfc6a06 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:04.815670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41661-8ee3-4c3d-8b5c-ea970dfc6a06 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:04.815993 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41661-8ee3-4c3d-8b5c-ea970dfc6a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:04.854180 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-e1d41661-8ee3-4c3d-8b5c-ea970dfc6a06 None None] MFA Rules not processed for user `29e6b3fca6794333913bdb880b0b5733`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:04.856222 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-e1d41661-8ee3-4c3d-8b5c-ea970dfc6a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:04.928964 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1401/2836] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:04.933966 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025771d-cf45-4af8-bf2b-9389a800974f admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:04.991677 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:05.010461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025771d-cf45-4af8-bf2b-9389a800974f admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:05.015545 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cf9cb-6d5f-4c6b-bcc5-aa63f86da460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:05.016164 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cf9cb-6d5f-4c6b-bcc5-aa63f86da460 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.016445 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cf9cb-6d5f-4c6b-bcc5-aa63f86da460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.016718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cf9cb-6d5f-4c6b-bcc5-aa63f86da460 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.017367 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cf9cb-6d5f-4c6b-bcc5-aa63f86da460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:05.019320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cf9cb-6d5f-4c6b-bcc5-aa63f86da460 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:05.051907 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1436/2837] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:49:04 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:49:05.058349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41661-8ee3-4c3d-8b5c-ea970dfc6a06 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.074620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41661-8ee3-4c3d-8b5c-ea970dfc6a06 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:05.133468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8482-85f0-40bc-a0cc-8097f2f30d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:05.134122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8482-85f0-40bc-a0cc-8097f2f30d31 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.134456 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8482-85f0-40bc-a0cc-8097f2f30d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.134737 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8482-85f0-40bc-a0cc-8097f2f30d31 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.135453 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a8482-85f0-40bc-a0cc-8097f2f30d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:05.137430 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a8482-85f0-40bc-a0cc-8097f2f30d31 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:05.160932 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1402/2838] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:49:05 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:05.165191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cf9cb-6d5f-4c6b-bcc5-aa63f86da460 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.176694 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cf9cb-6d5f-4c6b-bcc5-aa63f86da460 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:05.181762 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02f938-4c78-4084-93a6-9e6e24aeedeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:05.182305 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02f938-4c78-4084-93a6-9e6e24aeedeb admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.182584 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02f938-4c78-4084-93a6-9e6e24aeedeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.182855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02f938-4c78-4084-93a6-9e6e24aeedeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.183526 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02f938-4c78-4084-93a6-9e6e24aeedeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:05.185199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02f938-4c78-4084-93a6-9e6e24aeedeb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:05.196875 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1437/2839] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:05.201325 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8482-85f0-40bc-a0cc-8097f2f30d31 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.211759 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8482-85f0-40bc-a0cc-8097f2f30d31 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:05.217054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76207aa-1130-4050-8309-fe350812d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:05.217811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76207aa-1130-4050-8309-fe350812d052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.218088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76207aa-1130-4050-8309-fe350812d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.218360 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76207aa-1130-4050-8309-fe350812d052 admin admin] PATH_INFO: `/v3/projects/d955b3190b4e42b98458456ee4e24eed/users/ecf992a822354d5baf5992a05ec41a66/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.234412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76207aa-1130-4050-8309-fe350812d052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d955b3190b4e42b98458456ee4e24eed, user_id=ecf992a822354d5baf5992a05ec41a66, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:05.237099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76207aa-1130-4050-8309-fe350812d052 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:05.250994 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1403/2840] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:49:05 2022] PUT /identity/v3/projects/d955b3190b4e42b98458456ee4e24eed/users/ecf992a822354d5baf5992a05ec41a66/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:05.257137 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02f938-4c78-4084-93a6-9e6e24aeedeb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.268577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02f938-4c78-4084-93a6-9e6e24aeedeb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:05.325643 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d25071-d216-47db-afdf-b553fe490cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:05.326254 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d25071-d216-47db-afdf-b553fe490cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.326537 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d25071-d216-47db-afdf-b553fe490cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.326841 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d25071-d216-47db-afdf-b553fe490cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.327530 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d25071-d216-47db-afdf-b553fe490cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:05.329133 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d25071-d216-47db-afdf-b553fe490cdc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:05.340722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1438/2841] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:05.345078 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76207aa-1130-4050-8309-fe350812d052 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.356191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76207aa-1130-4050-8309-fe350812d052 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:05.361113 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39656-23c6-481e-bb02-f5171c5b5b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:05.361794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39656-23c6-481e-bb02-f5171c5b5b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.362081 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39656-23c6-481e-bb02-f5171c5b5b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.362361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39656-23c6-481e-bb02-f5171c5b5b2a admin admin] PATH_INFO: `/v3/projects/d955b3190b4e42b98458456ee4e24eed/users/ecf992a822354d5baf5992a05ec41a66/roles/609b1a993a394f0e900e17edccebaea5` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.364376 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf39656-23c6-481e-bb02-f5171c5b5b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d955b3190b4e42b98458456ee4e24eed, user_id=ecf992a822354d5baf5992a05ec41a66, role_id=609b1a993a394f0e900e17edccebaea5)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:05.367041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf39656-23c6-481e-bb02-f5171c5b5b2a admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:05.377706 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1404/2842] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:49:05 2022] PUT /identity/v3/projects/d955b3190b4e42b98458456ee4e24eed/users/ecf992a822354d5baf5992a05ec41a66/roles/609b1a993a394f0e900e17edccebaea5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:49:05.388608 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d266-33fc-431a-8785-091d8541c1fe None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.388931 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d266-33fc-431a-8785-091d8541c1fe None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.389293 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d266-33fc-431a-8785-091d8541c1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.420730 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-4ff8d266-33fc-431a-8785-091d8541c1fe None None] MFA Rules not processed for user `ecf992a822354d5baf5992a05ec41a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:05.422002 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4ff8d266-33fc-431a-8785-091d8541c1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:05.495295 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1439/2843] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:05.506604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39656-23c6-481e-bb02-f5171c5b5b2a admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.508444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-2bf39656-23c6-481e-bb02-f5171c5b5b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:05.554664 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:05.570107 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39656-23c6-481e-bb02-f5171c5b5b2a admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:05.574012 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439951cb-0272-44f6-8462-392db4f94e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:05.575162 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439951cb-0272-44f6-8462-392db4f94e58 service cinder] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.575444 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439951cb-0272-44f6-8462-392db4f94e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.575712 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439951cb-0272-44f6-8462-392db4f94e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.586115 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439951cb-0272-44f6-8462-392db4f94e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:05.587958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439951cb-0272-44f6-8462-392db4f94e58 service cinder] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:05.598997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1405/2844] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:05.670156 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8d266-33fc-431a-8785-091d8541c1fe None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.671786 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-4ff8d266-33fc-431a-8785-091d8541c1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:05.722246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:05.745553 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439951cb-0272-44f6-8462-392db4f94e58 service cinder] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.750457 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8d266-33fc-431a-8785-091d8541c1fe None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:05.756160 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:05.756720 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439951cb-0272-44f6-8462-392db4f94e58 service cinder] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:05.756917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.757139 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.757323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] PATH_INFO: `/v3/users/24246180165e4ce3bcf4eed25d5049fb` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.758632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24246180165e4ce3bcf4eed25d5049fb)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:05.760635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:05.762580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:05.763622 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.764364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.764732 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] PATH_INFO: `/v3/users/29e6b3fca6794333913bdb880b0b5733` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.766122 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e6b3fca6794333913bdb880b0b5733)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:05.768514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:05.822557 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24246180165e4ce3bcf4eed25d5049fb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.830401 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e6b3fca6794333913bdb880b0b5733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.831364 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e6b3fca6794333913bdb880b0b5733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.837701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24246180165e4ce3bcf4eed25d5049fb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.838514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24246180165e4ce3bcf4eed25d5049fb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.847604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e6b3fca6794333913bdb880b0b5733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.848031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24246180165e4ce3bcf4eed25d5049fb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.848787 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-be23b8d5-a7b8-493b-8c46-5afe777e1849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24246180165e4ce3bcf4eed25d5049fb'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.859451 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e6b3fca6794333913bdb880b0b5733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.860985 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-627062b0-085b-49df-8480-8f7b5a055da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e6b3fca6794333913bdb880b0b5733'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:05.865636 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1440/2845] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:05 2022] DELETE /identity/v3/users/24246180165e4ce3bcf4eed25d5049fb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:05.870987 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384738b1-c713-4c66-9fec-3f223b70159c None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.872020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384738b1-c713-4c66-9fec-3f223b70159c None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.872355 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384738b1-c713-4c66-9fec-3f223b70159c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.875982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1406/2846] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:05 2022] DELETE /identity/v3/users/29e6b3fca6794333913bdb880b0b5733 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:05.880460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a798f7-0b09-4e43-9825-96c35865a782 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:05.880758 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a798f7-0b09-4e43-9825-96c35865a782 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:05.881029 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a798f7-0b09-4e43-9825-96c35865a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:05.897048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-384738b1-c713-4c66-9fec-3f223b70159c None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:05.898280 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-384738b1-c713-4c66-9fec-3f223b70159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:05.901068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-26a798f7-0b09-4e43-9825-96c35865a782 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:05.902274 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-26a798f7-0b09-4e43-9825-96c35865a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:05.967667 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1441/2847] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:49:05.970295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1407/2848] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:05.981494 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384738b1-c713-4c66-9fec-3f223b70159c None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.984265 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-384738b1-c713-4c66-9fec-3f223b70159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:05.985425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a798f7-0b09-4e43-9825-96c35865a782 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:05.986851 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-26a798f7-0b09-4e43-9825-96c35865a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:06.056652 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384738b1-c713-4c66-9fec-3f223b70159c None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:06.058514 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a798f7-0b09-4e43-9825-96c35865a782 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:06.061641 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a332b-284c-4149-a2f3-3fdf86d0313d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:06.062260 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3fd5a-cbc9-4975-aa3d-6765cdfc0dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:06.062421 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a332b-284c-4149-a2f3-3fdf86d0313d service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:06.062559 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a332b-284c-4149-a2f3-3fdf86d0313d service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:06.062836 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a332b-284c-4149-a2f3-3fdf86d0313d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:06.062962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3fd5a-cbc9-4975-aa3d-6765cdfc0dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:06.063296 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3fd5a-cbc9-4975-aa3d-6765cdfc0dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:06.063582 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3fd5a-cbc9-4975-aa3d-6765cdfc0dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:06.073356 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3fd5a-cbc9-4975-aa3d-6765cdfc0dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:06.073595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a332b-284c-4149-a2f3-3fdf86d0313d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:06.075362 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3fd5a-cbc9-4975-aa3d-6765cdfc0dd9 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:06.075703 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a332b-284c-4149-a2f3-3fdf86d0313d service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:06.079789 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:06.086962 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1442/2849] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:06.088772 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1408/2850] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:49:06.389623 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a332b-284c-4149-a2f3-3fdf86d0313d service neutron] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:06.391631 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-867a332b-284c-4149-a2f3-3fdf86d0313d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:06.397153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3fd5a-cbc9-4975-aa3d-6765cdfc0dd9 service neutron] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:06.398632 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-49b3fd5a-cbc9-4975-aa3d-6765cdfc0dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:06.415452 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:06.422860 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3fd5a-cbc9-4975-aa3d-6765cdfc0dd9 service neutron] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:06.428042 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:06.428953 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:06.429185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:06.429551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] PATH_INFO: `/v3/projects/9b11cd32804a4847874ddb0f1ee9f3b7` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:06.431505 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b11cd32804a4847874ddb0f1ee9f3b7)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:06.434294 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:06.434912 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a332b-284c-4149-a2f3-3fdf86d0313d service neutron] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:06.443052 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:06.443903 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:06.444246 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:06.444618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] PATH_INFO: `/v3/projects/b8b9cec3f0cb45e59a9439aadfdb3081` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:06.446354 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b9cec3f0cb45e59a9439aadfdb3081)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:06.448983 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:06.491631 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b11cd32804a4847874ddb0f1ee9f3b7', 'request_id': 'req-072363f9-cffc-414c-8553-5f365c0f070d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.500463 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b11cd32804a4847874ddb0f1ee9f3b7', 'request_id': 'req-072363f9-cffc-414c-8553-5f365c0f070d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.506913 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b11cd32804a4847874ddb0f1ee9f3b7', 'request_id': 'req-072363f9-cffc-414c-8553-5f365c0f070d'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.508251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b9cec3f0cb45e59a9439aadfdb3081', 'request_id': 'req-b205c1ce-a2e5-4762-b47c-6a2a1030de51'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.515207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b9cec3f0cb45e59a9439aadfdb3081', 'request_id': 'req-b205c1ce-a2e5-4762-b47c-6a2a1030de51'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.520164 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] The token cache is being invalidate because project 9b11cd32804a4847874ddb0f1ee9f3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:06.520468 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.521191 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.522716 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1409/2851] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:06 2022] DELETE /identity/v3/projects/9b11cd32804a4847874ddb0f1ee9f3b7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:06.523752 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b9cec3f0cb45e59a9439aadfdb3081', 'request_id': 'req-b205c1ce-a2e5-4762-b47c-6a2a1030de51'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.538006 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] The token cache is being invalidate because project b8b9cec3f0cb45e59a9439aadfdb3081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:06.538314 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.539096 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.540846 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1443/2852] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:06 2022] DELETE /identity/v3/projects/b8b9cec3f0cb45e59a9439aadfdb3081 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:06.548351 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:06.549875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:06.624510 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072363f9-cffc-414c-8553-5f365c0f070d admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:06.704560 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:06.705210 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:06.705490 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:06.705771 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] PATH_INFO: `/v3/users/ecf992a822354d5baf5992a05ec41a66` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:06.707036 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf992a822354d5baf5992a05ec41a66)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:06.709041 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:06.763526 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:06.791245 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf992a822354d5baf5992a05ec41a66'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.792229 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf992a822354d5baf5992a05ec41a66'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.827408 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf992a822354d5baf5992a05ec41a66'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.839140 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf992a822354d5baf5992a05ec41a66'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.840021 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-46361812-9d84-4df8-9cec-33892d360089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf992a822354d5baf5992a05ec41a66'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:06.856399 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1410/2853] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:06 2022] DELETE /identity/v3/users/ecf992a822354d5baf5992a05ec41a66 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:07.159967 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:07.161658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:07.178830 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205c1ce-a2e5-4762-b47c-6a2a1030de51 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:07.241687 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:07.242347 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.242626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.242897 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] PATH_INFO: `/v3/projects/d955b3190b4e42b98458456ee4e24eed` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.244115 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d955b3190b4e42b98458456ee4e24eed)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:07.246279 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:07.297198 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd955b3190b4e42b98458456ee4e24eed', 'request_id': 'req-2d63674e-d00e-4594-86d2-becdcb629da9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:07.303696 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd955b3190b4e42b98458456ee4e24eed', 'request_id': 'req-2d63674e-d00e-4594-86d2-becdcb629da9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:07.311679 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd955b3190b4e42b98458456ee4e24eed', 'request_id': 'req-2d63674e-d00e-4594-86d2-becdcb629da9'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:07.324005 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] The token cache is being invalidate because project d955b3190b4e42b98458456ee4e24eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:07.324543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:07.325213 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-2d63674e-d00e-4594-86d2-becdcb629da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:07.327257 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1444/2854] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:07 2022] DELETE /identity/v3/projects/d955b3190b4e42b98458456ee4e24eed => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:07.332370 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c61c49-78ec-4b08-9330-b9f5ded1fe73 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.332904 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c61c49-78ec-4b08-9330-b9f5ded1fe73 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.333184 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c61c49-78ec-4b08-9330-b9f5ded1fe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.357363 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-45c61c49-78ec-4b08-9330-b9f5ded1fe73 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:07.358695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-45c61c49-78ec-4b08-9330-b9f5ded1fe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:07.421794 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1411/2855] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:07.429734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578788-ccf5-479c-a625-6546022e3397 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.430251 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578788-ccf5-479c-a625-6546022e3397 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.430374 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578788-ccf5-479c-a625-6546022e3397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.450548 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-b4578788-ccf5-479c-a625-6546022e3397 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:07.451809 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-b4578788-ccf5-479c-a625-6546022e3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:07.460428 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1445/2856] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:07.464673 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c61c49-78ec-4b08-9330-b9f5ded1fe73 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:07.475345 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c61c49-78ec-4b08-9330-b9f5ded1fe73 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:07.480067 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93d885-ecfa-4731-9ece-2649ade8d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:07.481290 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93d885-ecfa-4731-9ece-2649ade8d5dc admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.481572 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93d885-ecfa-4731-9ece-2649ade8d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.481849 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93d885-ecfa-4731-9ece-2649ade8d5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.482508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93d885-ecfa-4731-9ece-2649ade8d5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:49:07.482811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93d885-ecfa-4731-9ece-2649ade8d5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:07.484446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93d885-ecfa-4731-9ece-2649ade8d5dc admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:07.496958 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1412/2857] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:49:07.501485 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578788-ccf5-479c-a625-6546022e3397 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:07.513207 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578788-ccf5-479c-a625-6546022e3397 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:07.517874 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d10981-557a-41ce-a3b8-32e4a44bdc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:07.518483 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d10981-557a-41ce-a3b8-32e4a44bdc01 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.518764 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d10981-557a-41ce-a3b8-32e4a44bdc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.519067 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d10981-557a-41ce-a3b8-32e4a44bdc01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.519701 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d10981-557a-41ce-a3b8-32e4a44bdc01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:07.521595 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d10981-557a-41ce-a3b8-32e4a44bdc01 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:07.528048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:07.553113 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1446/2858] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:49:07 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:49:07.557367 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93d885-ecfa-4731-9ece-2649ade8d5dc admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:07.568011 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93d885-ecfa-4731-9ece-2649ade8d5dc admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:07.632901 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be267a32-2262-463d-b2ca-9d3ef43e2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:07.633675 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be267a32-2262-463d-b2ca-9d3ef43e2b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.634473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be267a32-2262-463d-b2ca-9d3ef43e2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.634473 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be267a32-2262-463d-b2ca-9d3ef43e2b01 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.635080 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be267a32-2262-463d-b2ca-9d3ef43e2b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:07.637927 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be267a32-2262-463d-b2ca-9d3ef43e2b01 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:07.661723 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1413/2859] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:49:07 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 15:49:07.665934 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d10981-557a-41ce-a3b8-32e4a44bdc01 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:07.676458 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d10981-557a-41ce-a3b8-32e4a44bdc01 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:07.681235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c13a-8224-4696-88f4-583fc78b0cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:07.681838 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c13a-8224-4696-88f4-583fc78b0cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.682118 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c13a-8224-4696-88f4-583fc78b0cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.682380 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9c13a-8224-4696-88f4-583fc78b0cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.683538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9c13a-8224-4696-88f4-583fc78b0cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:07.684668 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9c13a-8224-4696-88f4-583fc78b0cd4 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:07.695103 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1447/2860] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:07.699892 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be267a32-2262-463d-b2ca-9d3ef43e2b01 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:07.710005 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be267a32-2262-463d-b2ca-9d3ef43e2b01 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:07.714620 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb7cc8-8243-4c9b-b8b5-bec6eb31db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:07.715879 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb7cc8-8243-4c9b-b8b5-bec6eb31db02 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.716152 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb7cc8-8243-4c9b-b8b5-bec6eb31db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.716418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb7cc8-8243-4c9b-b8b5-bec6eb31db02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.717068 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb7cc8-8243-4c9b-b8b5-bec6eb31db02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:07.718670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb7cc8-8243-4c9b-b8b5-bec6eb31db02 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:07.729930 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1414/2861] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:07.734980 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c13a-8224-4696-88f4-583fc78b0cd4 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:07.744955 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9c13a-8224-4696-88f4-583fc78b0cd4 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:07.749734 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4704dd-2323-45b4-9e42-606bd1f620b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:07.750383 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4704dd-2323-45b4-9e42-606bd1f620b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.750657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4704dd-2323-45b4-9e42-606bd1f620b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.750977 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4704dd-2323-45b4-9e42-606bd1f620b2 admin admin] PATH_INFO: `/v3/projects/0134f738bdb3477cb6866733c3ceca82/users/6be09c1252d74166b142690b84435057/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.766857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4704dd-2323-45b4-9e42-606bd1f620b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0134f738bdb3477cb6866733c3ceca82, user_id=6be09c1252d74166b142690b84435057, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:07.769742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4704dd-2323-45b4-9e42-606bd1f620b2 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:07.784922 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1448/2862] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:49:07 2022] PUT /identity/v3/projects/0134f738bdb3477cb6866733c3ceca82/users/6be09c1252d74166b142690b84435057/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:07.854462 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c634-5a6d-43ee-98b4-7ceedd7b2dd1 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:07.854741 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c634-5a6d-43ee-98b4-7ceedd7b2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:07.855061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c634-5a6d-43ee-98b4-7ceedd7b2dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:07.881568 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:07.885537 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-5bc2c634-5a6d-43ee-98b4-7ceedd7b2dd1 None None] MFA Rules not processed for user `6be09c1252d74166b142690b84435057`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:07.888023 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-5bc2c634-5a6d-43ee-98b4-7ceedd7b2dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:07.955776 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1415/2863] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:07.971706 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4704dd-2323-45b4-9e42-606bd1f620b2 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:07.973430 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-de4704dd-2323-45b4-9e42-606bd1f620b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:08.043618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4704dd-2323-45b4-9e42-606bd1f620b2 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:08.048031 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb90e4-b5ef-4e6c-b691-28af73beb9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:08.048898 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb90e4-b5ef-4e6c-b691-28af73beb9ff service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:08.049200 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb90e4-b5ef-4e6c-b691-28af73beb9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:08.049586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb90e4-b5ef-4e6c-b691-28af73beb9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:08.061093 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb90e4-b5ef-4e6c-b691-28af73beb9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:08.062854 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb90e4-b5ef-4e6c-b691-28af73beb9ff service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:08.075077 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1449/2864] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:08.095089 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c634-5a6d-43ee-98b4-7ceedd7b2dd1 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:08.170261 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c634-5a6d-43ee-98b4-7ceedd7b2dd1 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:08.174962 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:08.175603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:08.175885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:08.176157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] PATH_INFO: `/v3/users/6be09c1252d74166b142690b84435057` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:08.177372 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be09c1252d74166b142690b84435057)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:08.179392 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:08.239221 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be09c1252d74166b142690b84435057'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:08.239840 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be09c1252d74166b142690b84435057'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:08.252853 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be09c1252d74166b142690b84435057'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:08.261017 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be09c1252d74166b142690b84435057'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:08.262099 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be09c1252d74166b142690b84435057'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:08.275576 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1416/2865] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:08 2022] DELETE /identity/v3/users/6be09c1252d74166b142690b84435057 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:08.280539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b8d30-4611-4bf4-bc59-f7d0f73cbf50 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:08.281085 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b8d30-4611-4bf4-bc59-f7d0f73cbf50 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:08.281902 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b8d30-4611-4bf4-bc59-f7d0f73cbf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:08.301655 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-9d9b8d30-4611-4bf4-bc59-f7d0f73cbf50 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:08.302896 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9d9b8d30-4611-4bf4-bc59-f7d0f73cbf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:08.403412 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1450/2866] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:08.416283 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:08.417740 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:08.451896 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:08.490320 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6434-25c4-4194-973d-e67ef7a0ac83 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:08.494431 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a563386-9132-4ef0-b663-d491139ed5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:08.495153 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563386-9132-4ef0-b663-d491139ed5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:08.495484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563386-9132-4ef0-b663-d491139ed5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:08.495800 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a563386-9132-4ef0-b663-d491139ed5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:08.506634 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a563386-9132-4ef0-b663-d491139ed5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:08.508143 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a563386-9132-4ef0-b663-d491139ed5e8 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:08.518542 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1417/2867] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 15:49:08.886717 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b8d30-4611-4bf4-bc59-f7d0f73cbf50 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:08.888206 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-9d9b8d30-4611-4bf4-bc59-f7d0f73cbf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:08.901461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b8d30-4611-4bf4-bc59-f7d0f73cbf50 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:08.907202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:08.907857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:08.908136 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:08.908410 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] PATH_INFO: `/v3/projects/0134f738bdb3477cb6866733c3ceca82` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:08.909567 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0134f738bdb3477cb6866733c3ceca82)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:08.911519 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:08.981396 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0134f738bdb3477cb6866733c3ceca82', 'request_id': 'req-5f48026c-14fe-4834-857e-753cd14a6281'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:08.985610 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:08.994894 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0134f738bdb3477cb6866733c3ceca82', 'request_id': 'req-5f48026c-14fe-4834-857e-753cd14a6281'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:09.008171 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0134f738bdb3477cb6866733c3ceca82', 'request_id': 'req-5f48026c-14fe-4834-857e-753cd14a6281'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:09.020828 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] The token cache is being invalidate because project 0134f738bdb3477cb6866733c3ceca82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:09.021117 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:09.021775 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-5f48026c-14fe-4834-857e-753cd14a6281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:09.023388 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1451/2868] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:08 2022] DELETE /identity/v3/projects/0134f738bdb3477cb6866733c3ceca82 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:09.030263 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b3206-c544-4400-97b7-fac787ea8b04 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.030536 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b3206-c544-4400-97b7-fac787ea8b04 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.031093 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b3206-c544-4400-97b7-fac787ea8b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.051114 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ed8b3206-c544-4400-97b7-fac787ea8b04 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:09.052352 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ed8b3206-c544-4400-97b7-fac787ea8b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:09.114762 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1418/2869] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:09.122539 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118b98-b859-4f47-96db-c54a9c510284 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.122818 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118b98-b859-4f47-96db-c54a9c510284 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.123132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4118b98-b859-4f47-96db-c54a9c510284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.143045 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-e4118b98-b859-4f47-96db-c54a9c510284 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:09.144266 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-e4118b98-b859-4f47-96db-c54a9c510284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:09.152262 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1452/2870] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:09.157344 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b3206-c544-4400-97b7-fac787ea8b04 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:09.166982 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b3206-c544-4400-97b7-fac787ea8b04 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:09.171724 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2554206-4e5a-4acf-8ab3-04426894a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:09.172328 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554206-4e5a-4acf-8ab3-04426894a921 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.172605 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554206-4e5a-4acf-8ab3-04426894a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.172875 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554206-4e5a-4acf-8ab3-04426894a921 admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.173527 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2554206-4e5a-4acf-8ab3-04426894a921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:49:09.173882 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2554206-4e5a-4acf-8ab3-04426894a921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:09.175460 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2554206-4e5a-4acf-8ab3-04426894a921 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:09.187484 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1419/2871] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:49:09.192056 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118b98-b859-4f47-96db-c54a9c510284 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:09.202072 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4118b98-b859-4f47-96db-c54a9c510284 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:09.206757 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396f19-0bb9-49d7-a888-155682208df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:09.207389 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396f19-0bb9-49d7-a888-155682208df1 admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.207671 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396f19-0bb9-49d7-a888-155682208df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.207943 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396f19-0bb9-49d7-a888-155682208df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.208575 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1396f19-0bb9-49d7-a888-155682208df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:09.210508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1396f19-0bb9-49d7-a888-155682208df1 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:09.238235 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1453/2872] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:49:09 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:09.242718 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2554206-4e5a-4acf-8ab3-04426894a921 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:09.253047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2554206-4e5a-4acf-8ab3-04426894a921 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:09.313419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2351b3-4499-47eb-bec9-cdd6c1c9db36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:09.314028 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2351b3-4499-47eb-bec9-cdd6c1c9db36 admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.314313 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2351b3-4499-47eb-bec9-cdd6c1c9db36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.314592 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2351b3-4499-47eb-bec9-cdd6c1c9db36 admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.315268 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2351b3-4499-47eb-bec9-cdd6c1c9db36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:09.317880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2351b3-4499-47eb-bec9-cdd6c1c9db36 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:09.347412 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1420/2873] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:49:09 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:09.351603 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396f19-0bb9-49d7-a888-155682208df1 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:09.365219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396f19-0bb9-49d7-a888-155682208df1 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:09.370461 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3afa4-0d43-482c-a579-6e150402b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:09.371019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3afa4-0d43-482c-a579-6e150402b8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.371880 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3afa4-0d43-482c-a579-6e150402b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.372129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3afa4-0d43-482c-a579-6e150402b8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.372718 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3afa4-0d43-482c-a579-6e150402b8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:09.374381 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3afa4-0d43-482c-a579-6e150402b8b3 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:09.385935 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1454/2874] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:09.391111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2351b3-4499-47eb-bec9-cdd6c1c9db36 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:09.406368 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2351b3-4499-47eb-bec9-cdd6c1c9db36 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:09.412857 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2e09-c070-4e1b-a3e6-47a955b885d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:09.413753 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2e09-c070-4e1b-a3e6-47a955b885d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.414118 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2e09-c070-4e1b-a3e6-47a955b885d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.414440 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2e09-c070-4e1b-a3e6-47a955b885d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.415349 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2e09-c070-4e1b-a3e6-47a955b885d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:09.417765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2e09-c070-4e1b-a3e6-47a955b885d5 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:09.433624 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1421/2875] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:09.438323 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3afa4-0d43-482c-a579-6e150402b8b3 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:09.448688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3afa4-0d43-482c-a579-6e150402b8b3 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:09.454418 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03e0a4-4fd8-4b8d-a5a1-e8c239fbf533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:09.455132 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03e0a4-4fd8-4b8d-a5a1-e8c239fbf533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.455416 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03e0a4-4fd8-4b8d-a5a1-e8c239fbf533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.455837 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03e0a4-4fd8-4b8d-a5a1-e8c239fbf533 admin admin] PATH_INFO: `/v3/projects/cfc5469eb77c4325bb6e237a42de6984/users/242a33b5b65c483cb34a298aed1ff4b0/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.472939 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03e0a4-4fd8-4b8d-a5a1-e8c239fbf533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc5469eb77c4325bb6e237a42de6984, user_id=242a33b5b65c483cb34a298aed1ff4b0, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:09.475974 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03e0a4-4fd8-4b8d-a5a1-e8c239fbf533 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:09.490260 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1455/2876] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:49:09 2022] PUT /identity/v3/projects/cfc5469eb77c4325bb6e237a42de6984/users/242a33b5b65c483cb34a298aed1ff4b0/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:09.501764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c985-e24f-438a-9232-9a00a192cf3d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.502181 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c985-e24f-438a-9232-9a00a192cf3d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.502619 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47c985-e24f-438a-9232-9a00a192cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.535206 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-ae47c985-e24f-438a-9232-9a00a192cf3d None None] MFA Rules not processed for user `242a33b5b65c483cb34a298aed1ff4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:09.536788 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-ae47c985-e24f-438a-9232-9a00a192cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:09.558529 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:09.619371 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1422/2877] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:09.631586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03e0a4-4fd8-4b8d-a5a1-e8c239fbf533 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:09.633572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ae03e0a4-4fd8-4b8d-a5a1-e8c239fbf533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:09.692699 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03e0a4-4fd8-4b8d-a5a1-e8c239fbf533 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:09.696688 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1adca-4fdc-44dc-90c5-93d5dbd08ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:09.697318 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1adca-4fdc-44dc-90c5-93d5dbd08ffc service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.697612 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1adca-4fdc-44dc-90c5-93d5dbd08ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.697877 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1adca-4fdc-44dc-90c5-93d5dbd08ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.710358 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1adca-4fdc-44dc-90c5-93d5dbd08ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:09.712602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1adca-4fdc-44dc-90c5-93d5dbd08ffc service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:09.725572 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1456/2878] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:09.748894 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47c985-e24f-438a-9232-9a00a192cf3d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:09.830563 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47c985-e24f-438a-9232-9a00a192cf3d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:09.835814 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:09.836745 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.837065 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.837426 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] PATH_INFO: `/v3/users/242a33b5b65c483cb34a298aed1ff4b0` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.838679 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=242a33b5b65c483cb34a298aed1ff4b0)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:09.840671 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:09.898243 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242a33b5b65c483cb34a298aed1ff4b0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:09.899226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242a33b5b65c483cb34a298aed1ff4b0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:09.915571 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242a33b5b65c483cb34a298aed1ff4b0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:09.929474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242a33b5b65c483cb34a298aed1ff4b0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:09.930116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242a33b5b65c483cb34a298aed1ff4b0'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:09.949422 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1423/2879] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:09 2022] DELETE /identity/v3/users/242a33b5b65c483cb34a298aed1ff4b0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:09.956547 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475db02b-b8f6-4399-97a1-f9f28185f91a None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:09.957175 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475db02b-b8f6-4399-97a1-f9f28185f91a None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:09.957308 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475db02b-b8f6-4399-97a1-f9f28185f91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:09.983320 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-475db02b-b8f6-4399-97a1-f9f28185f91a None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:09.984538 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-475db02b-b8f6-4399-97a1-f9f28185f91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:10.044562 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1457/2880] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:10.054543 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:10.055997 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:10.103556 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:10.120603 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e56a-f961-4c49-b62e-3d416cb53ced admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:10.124551 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02707b01-6945-441f-9146-2b9d7890ecf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:10.125168 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02707b01-6945-441f-9146-2b9d7890ecf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:10.125446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02707b01-6945-441f-9146-2b9d7890ecf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:10.125721 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02707b01-6945-441f-9146-2b9d7890ecf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:10.135141 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02707b01-6945-441f-9146-2b9d7890ecf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:10.136580 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02707b01-6945-441f-9146-2b9d7890ecf8 service neutron] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:10.146225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1424/2881] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:10.438134 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475db02b-b8f6-4399-97a1-f9f28185f91a None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:10.440277 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-475db02b-b8f6-4399-97a1-f9f28185f91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:10.464083 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475db02b-b8f6-4399-97a1-f9f28185f91a None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:10.472522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:10.473596 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:10.474095 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:10.474586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] PATH_INFO: `/v3/projects/cfc5469eb77c4325bb6e237a42de6984` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:10.476857 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc5469eb77c4325bb6e237a42de6984)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:10.481508 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:10.504908 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:10.549515 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc5469eb77c4325bb6e237a42de6984', 'request_id': 'req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:10.555059 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc5469eb77c4325bb6e237a42de6984', 'request_id': 'req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:10.563888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc5469eb77c4325bb6e237a42de6984', 'request_id': 'req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:10.577472 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] The token cache is being invalidate because project cfc5469eb77c4325bb6e237a42de6984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81766) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:10.577776 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:10.578435 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-f0a59cd5-c4d5-4c86-ae61-9e150e128a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:10.580017 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1458/2882] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:10 2022] DELETE /identity/v3/projects/cfc5469eb77c4325bb6e237a42de6984 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:10.585574 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f32349-4634-4da6-bbb6-6fe5ad955ba8 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:10.586266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f32349-4634-4da6-bbb6-6fe5ad955ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:10.586266 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f32349-4634-4da6-bbb6-6fe5ad955ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:10.607489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-60f32349-4634-4da6-bbb6-6fe5ad955ba8 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:10.608854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-60f32349-4634-4da6-bbb6-6fe5ad955ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:10.689868 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1425/2883] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:10.705673 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34601ddc-6389-4426-baf0-3822fa017c96 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:10.706219 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34601ddc-6389-4426-baf0-3822fa017c96 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:10.706722 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34601ddc-6389-4426-baf0-3822fa017c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:10.738048 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-34601ddc-6389-4426-baf0-3822fa017c96 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:10.739349 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-34601ddc-6389-4426-baf0-3822fa017c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:10.748062 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1459/2884] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:10.752466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f32349-4634-4da6-bbb6-6fe5ad955ba8 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:10.762874 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f32349-4634-4da6-bbb6-6fe5ad955ba8 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:10.767681 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e917b-2132-4685-96ba-735ca8accd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:10.768295 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e917b-2132-4685-96ba-735ca8accd7c admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:10.768573 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e917b-2132-4685-96ba-735ca8accd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:10.768845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e917b-2132-4685-96ba-735ca8accd7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:10.769513 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e917b-2132-4685-96ba-735ca8accd7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81767) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 15:49:10.769811 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e917b-2132-4685-96ba-735ca8accd7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:10.771646 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e917b-2132-4685-96ba-735ca8accd7c admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:10.788670 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1426/2885] 10.222.0.89 () {58 vars in 1153 bytes} [Fri Aug 26 15:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 15:49:10.793094 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34601ddc-6389-4426-baf0-3822fa017c96 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:10.804003 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34601ddc-6389-4426-baf0-3822fa017c96 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:10.808932 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3c8ef-5302-46c1-b265-9605cfb8c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:10.809884 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3c8ef-5302-46c1-b265-9605cfb8c0eb admin admin] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:10.810162 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3c8ef-5302-46c1-b265-9605cfb8c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:10.810441 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3c8ef-5302-46c1-b265-9605cfb8c0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:10.811123 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3c8ef-5302-46c1-b265-9605cfb8c0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:10.813019 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3c8ef-5302-46c1-b265-9605cfb8c0eb admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:10.845285 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1460/2886] 10.222.0.89 () {60 vars in 1153 bytes} [Fri Aug 26 15:49:10 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:10.850226 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e917b-2132-4685-96ba-735ca8accd7c admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:10.869025 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e917b-2132-4685-96ba-735ca8accd7c admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:10.946111 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5b8b-6736-4a3f-9c02-5feaf43af3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:10.946812 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5b8b-6736-4a3f-9c02-5feaf43af3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:10.947179 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5b8b-6736-4a3f-9c02-5feaf43af3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:10.947324 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5b8b-6736-4a3f-9c02-5feaf43af3fb admin admin] PATH_INFO: `/v3/users` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:10.947909 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c5b8b-6736-4a3f-9c02-5feaf43af3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:10.950450 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c5b8b-6736-4a3f-9c02-5feaf43af3fb admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:10.974369 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1427/2887] 10.222.0.89 () {60 vars in 1144 bytes} [Fri Aug 26 15:49:10 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 15:49:10.978777 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3c8ef-5302-46c1-b265-9605cfb8c0eb admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:10.991602 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3c8ef-5302-46c1-b265-9605cfb8c0eb admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:10.997362 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c718e-d188-4389-9768-207852cc6f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:10.998122 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c718e-d188-4389-9768-207852cc6f51 admin admin] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:10.998487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c718e-d188-4389-9768-207852cc6f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:10.998827 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c718e-d188-4389-9768-207852cc6f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:10.999657 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c718e-d188-4389-9768-207852cc6f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:11.001370 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c718e-d188-4389-9768-207852cc6f51 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:11.017817 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1461/2888] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 15:49:11.019489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5b8b-6736-4a3f-9c02-5feaf43af3fb admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:11.032495 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5b8b-6736-4a3f-9c02-5feaf43af3fb admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:11.039765 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0ad74-e586-440a-9b30-ac5926bfeae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:11.040611 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0ad74-e586-440a-9b30-ac5926bfeae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:11.041039 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0ad74-e586-440a-9b30-ac5926bfeae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:11.041458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0ad74-e586-440a-9b30-ac5926bfeae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:11.042458 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0ad74-e586-440a-9b30-ac5926bfeae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:11.045465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0ad74-e586-440a-9b30-ac5926bfeae9 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:11.065059 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1428/2889] 10.222.0.89 () {58 vars in 1122 bytes} [Fri Aug 26 15:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 15:49:11.066419 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c718e-d188-4389-9768-207852cc6f51 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:11.077336 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c718e-d188-4389-9768-207852cc6f51 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:11.085867 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536e9cd-6c84-4622-978b-2899d97682bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:11.086648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536e9cd-6c84-4622-978b-2899d97682bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:11.086891 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536e9cd-6c84-4622-978b-2899d97682bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:11.087211 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536e9cd-6c84-4622-978b-2899d97682bf admin admin] PATH_INFO: `/v3/projects/49e770947b8043678d388eb603178031/users/910338f4f87e4778903906b3f9556a7b/roles/79bef6f5048d441d883bb015c7887170` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:11.105119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536e9cd-6c84-4622-978b-2899d97682bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e770947b8043678d388eb603178031, user_id=910338f4f87e4778903906b3f9556a7b, role_id=79bef6f5048d441d883bb015c7887170)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:11.108984 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536e9cd-6c84-4622-978b-2899d97682bf admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:11.126039 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1462/2890] 10.222.0.89 () {60 vars in 1483 bytes} [Fri Aug 26 15:49:11 2022] PUT /identity/v3/projects/49e770947b8043678d388eb603178031/users/910338f4f87e4778903906b3f9556a7b/roles/79bef6f5048d441d883bb015c7887170 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:11.137694 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7f1e8-b186-4b1c-88cf-f08938473f7a None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:11.138305 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7f1e8-b186-4b1c-88cf-f08938473f7a None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:11.138707 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7f1e8-b186-4b1c-88cf-f08938473f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:11.170504 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-b3a7f1e8-b186-4b1c-88cf-f08938473f7a None None] MFA Rules not processed for user `910338f4f87e4778903906b3f9556a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:11.171854 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-b3a7f1e8-b186-4b1c-88cf-f08938473f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:11.216410 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:11.246091 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1429/2891] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:11.257543 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536e9cd-6c84-4622-978b-2899d97682bf admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:11.259626 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1536e9cd-6c84-4622-978b-2899d97682bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:11.334759 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536e9cd-6c84-4622-978b-2899d97682bf admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:11.338648 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da188-6104-49d3-afe7-b66a8f84f34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a128a6b32fd4a54ad0146551fe77879', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:11.339303 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da188-6104-49d3-afe7-b66a8f84f34f service cinder] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:11.339582 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da188-6104-49d3-afe7-b66a8f84f34f service cinder] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:11.339862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da188-6104-49d3-afe7-b66a8f84f34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:11.349801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7da188-6104-49d3-afe7-b66a8f84f34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:11.351278 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7da188-6104-49d3-afe7-b66a8f84f34f service cinder] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:11.362186 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1463/2892] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:12.763171 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afa085-85f2-459a-b2b4-ccf62704873d None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:12.763713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afa085-85f2-459a-b2b4-ccf62704873d None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:12.763713 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afa085-85f2-459a-b2b4-ccf62704873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:12.783046 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-25afa085-85f2-459a-b2b4-ccf62704873d None None] MFA Rules not processed for user `910338f4f87e4778903906b3f9556a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:12.784259 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-25afa085-85f2-459a-b2b4-ccf62704873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:12.791088 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1430/2893] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:21.357073 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:22.778768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=13 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:28.071119 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e63dd-038d-490d-ab7e-ac7811aff043 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:28.071617 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e63dd-038d-490d-ab7e-ac7811aff043 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:28.071723 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e63dd-038d-490d-ab7e-ac7811aff043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:28.091415 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-ca0e63dd-038d-490d-ab7e-ac7811aff043 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:28.092618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-ca0e63dd-038d-490d-ab7e-ac7811aff043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:28.148490 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1464/2894] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:49:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:28.161015 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afa085-85f2-459a-b2b4-ccf62704873d None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:28.162547 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-25afa085-85f2-459a-b2b4-ccf62704873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:28.238963 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afa085-85f2-459a-b2b4-ccf62704873d None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:28.244147 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af269b-9220-431f-8222-597ca4d7a30f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:28.244770 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af269b-9220-431f-8222-597ca4d7a30f service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:28.245035 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af269b-9220-431f-8222-597ca4d7a30f service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:28.245308 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af269b-9220-431f-8222-597ca4d7a30f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:28.253781 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af269b-9220-431f-8222-597ca4d7a30f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:28.255397 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af269b-9220-431f-8222-597ca4d7a30f service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:28.263873 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1431/2895] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:49:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:49:28.787812 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dde176-fe29-4ee0-a703-818c7eeb1366 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:28.788202 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dde176-fe29-4ee0-a703-818c7eeb1366 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:28.788487 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dde176-fe29-4ee0-a703-818c7eeb1366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:28.808433 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-53dde176-fe29-4ee0-a703-818c7eeb1366 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:28.810249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-53dde176-fe29-4ee0-a703-818c7eeb1366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:28.817319 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1465/2896] 10.222.0.89 () {58 vars in 967 bytes} [Fri Aug 26 15:49:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:28.829653 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af269b-9220-431f-8222-597ca4d7a30f service swift] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:28.841185 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af269b-9220-431f-8222-597ca4d7a30f service swift] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:28.846474 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea33990-11f6-43a6-9f06-7a28065cc619 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:28.847116 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea33990-11f6-43a6-9f06-7a28065cc619 service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:28.847398 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea33990-11f6-43a6-9f06-7a28065cc619 service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:28.847669 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea33990-11f6-43a6-9f06-7a28065cc619 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:28.857361 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea33990-11f6-43a6-9f06-7a28065cc619 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:28.858989 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea33990-11f6-43a6-9f06-7a28065cc619 service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:28.867880 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1432/2897] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:49:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:49:29.152474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996239-570b-4b75-973b-9f902fc8956b None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:29.152474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996239-570b-4b75-973b-9f902fc8956b None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:29.152474 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996239-570b-4b75-973b-9f902fc8956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:29.174534 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-c9996239-570b-4b75-973b-9f902fc8956b None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:29.175832 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-c9996239-570b-4b75-973b-9f902fc8956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:29.187368 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1466/2898] 10.222.0.89 () {58 vars in 1009 bytes} [Fri Aug 26 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:29.203508 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea33990-11f6-43a6-9f06-7a28065cc619 service swift] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:29.216225 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea33990-11f6-43a6-9f06-7a28065cc619 service swift] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:29.223459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aaaae-c700-4bf4-873e-8efc53ac8506 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:29.224466 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aaaae-c700-4bf4-873e-8efc53ac8506 service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:29.225192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aaaae-c700-4bf4-873e-8efc53ac8506 service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:29.225192 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aaaae-c700-4bf4-873e-8efc53ac8506 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:29.235103 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0aaaae-c700-4bf4-873e-8efc53ac8506 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:29.236876 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0aaaae-c700-4bf4-873e-8efc53ac8506 service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:29.245924 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1433/2899] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:49:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 15:49:29.648061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a4b6-801b-4eed-bc91-58e137f2f774 None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:29.648632 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a4b6-801b-4eed-bc91-58e137f2f774 None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:29.649225 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a4b6-801b-4eed-bc91-58e137f2f774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:29.678640 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-2156a4b6-801b-4eed-bc91-58e137f2f774 None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:29.680109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-2156a4b6-801b-4eed-bc91-58e137f2f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:29.689142 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1467/2900] 10.222.0.89 () {58 vars in 967 bytes} [Fri Aug 26 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 15:49:29.710047 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aaaae-c700-4bf4-873e-8efc53ac8506 service swift] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:29.722097 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aaaae-c700-4bf4-873e-8efc53ac8506 service swift] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:29.730768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cce87-9fb4-4abe-a7d3-bbd09be55094 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:29.731494 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cce87-9fb4-4abe-a7d3-bbd09be55094 service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:29.732018 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cce87-9fb4-4abe-a7d3-bbd09be55094 service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:29.732446 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cce87-9fb4-4abe-a7d3-bbd09be55094 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:29.743907 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cce87-9fb4-4abe-a7d3-bbd09be55094 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:29.747092 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cce87-9fb4-4abe-a7d3-bbd09be55094 service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:29.757550 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1434/2901] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:49:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:49:32.387464 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a4b6-801b-4eed-bc91-58e137f2f774 None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:32.468586 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a4b6-801b-4eed-bc91-58e137f2f774 None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:32.473398 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:32.474257 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:32.474742 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:32.475167 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] PATH_INFO: `/v3/users/910338f4f87e4778903906b3f9556a7b` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:32.476798 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=910338f4f87e4778903906b3f9556a7b)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:32.478808 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:32.537945 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910338f4f87e4778903906b3f9556a7b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:32.552109 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910338f4f87e4778903906b3f9556a7b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:32.552855 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910338f4f87e4778903906b3f9556a7b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:32.562528 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910338f4f87e4778903906b3f9556a7b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:32.563406 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910338f4f87e4778903906b3f9556a7b'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:32.578654 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1468/2902] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:32 2022] DELETE /identity/v3/users/910338f4f87e4778903906b3f9556a7b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:32.583304 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735ef4d-03cd-42ce-9d3d-2d2b929466c0 None None] REQUEST_METHOD: `POST` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:32.583827 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735ef4d-03cd-42ce-9d3d-2d2b929466c0 None None] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:32.583947 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735ef4d-03cd-42ce-9d3d-2d2b929466c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:32.608442 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.auth.core [None req-4735ef4d-03cd-42ce-9d3d-2d2b929466c0 None None] MFA Rules not processed for user `6a0674a0b804427ca12cbbcd5e4a20f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81767) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:32.611604 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4735ef4d-03cd-42ce-9d3d-2d2b929466c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:32.681368 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1435/2903] 10.222.0.89 () {58 vars in 958 bytes} [Fri Aug 26 15:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:32.691576 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:32.693101 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:32.700037 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:32.773230 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cebc2-9456-454f-9ec1-ae16d13308cc admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:32.779801 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc0286-fa8e-4a04-bc36-8630e70d1139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a82c500de745c0b55df44b7f641706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:32.780833 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0286-fa8e-4a04-bc36-8630e70d1139 service neutron] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:32.781577 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0286-fa8e-4a04-bc36-8630e70d1139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:32.782066 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0286-fa8e-4a04-bc36-8630e70d1139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:32.799141 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc0286-fa8e-4a04-bc36-8630e70d1139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:32.802020 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc0286-fa8e-4a04-bc36-8630e70d1139 service neutron] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:32.819190 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1469/2904] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:49:32.997698 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735ef4d-03cd-42ce-9d3d-2d2b929466c0 None None] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:32.999169 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-4735ef4d-03cd-42ce-9d3d-2d2b929466c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:33.011252 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735ef4d-03cd-42ce-9d3d-2d2b929466c0 None None] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:33.016459 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:33.017178 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:33.017491 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:33.017769 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] PATH_INFO: `/v3/projects/49e770947b8043678d388eb603178031` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:33.018922 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e770947b8043678d388eb603178031)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:33.020856 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:33.066642 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:33.070385 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e770947b8043678d388eb603178031', 'request_id': 'req-460b2191-625a-4d11-8ca5-0b1281f19865'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:33.078763 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e770947b8043678d388eb603178031', 'request_id': 'req-460b2191-625a-4d11-8ca5-0b1281f19865'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:33.084419 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e770947b8043678d388eb603178031', 'request_id': 'req-460b2191-625a-4d11-8ca5-0b1281f19865'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:33.096050 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] The token cache is being invalidate because project 49e770947b8043678d388eb603178031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:33.096339 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:33.096995 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:33.098587 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1436/2905] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:32 2022] DELETE /identity/v3/projects/49e770947b8043678d388eb603178031 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:37.233340 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb78107-80a8-4e9d-9689-2930fdac12da None None] REQUEST_METHOD: `POST` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:37.233917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb78107-80a8-4e9d-9689-2930fdac12da None None] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:37.233917 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb78107-80a8-4e9d-9689-2930fdac12da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:37.253307 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.auth.core [None req-1bb78107-80a8-4e9d-9689-2930fdac12da None None] MFA Rules not processed for user `b91335b29d0b43d5993c44a3e40d4a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81766) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 15:49:37.254615 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1bb78107-80a8-4e9d-9689-2930fdac12da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:37.311447 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1470/2906] 10.222.0.89 () {58 vars in 967 bytes} [Fri Aug 26 15:49:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 15:49:37.332523 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:37.333944 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:37.404708 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b2191-625a-4d11-8ca5-0b1281f19865 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:37.409803 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf299723-44b4-4da3-bab6-871505e7bed6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9df361aabe544b618c7c1c1d98b8751a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:37.410425 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf299723-44b4-4da3-bab6-871505e7bed6 service swift] REQUEST_METHOD: `GET` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:37.410691 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf299723-44b4-4da3-bab6-871505e7bed6 service swift] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:37.410986 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf299723-44b4-4da3-bab6-871505e7bed6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:37.420246 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf299723-44b4-4da3-bab6-871505e7bed6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:37.421824 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf299723-44b4-4da3-bab6-871505e7bed6 service swift] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:37.430157 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1437/2907] 10.222.0.89 () {60 vars in 1384 bytes} [Fri Aug 26 15:49:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 15:49:44.151658 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb78107-80a8-4e9d-9689-2930fdac12da None None] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:44.153199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-1bb78107-80a8-4e9d-9689-2930fdac12da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:44.240209 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb78107-80a8-4e9d-9689-2930fdac12da None None] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:44.245470 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:44.249309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:44.249309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:44.249309 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] PATH_INFO: `/v3/users/757dce1558354968862f47eae45129bc` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:44.250131 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757dce1558354968862f47eae45129bc)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:44.252249 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:44.320199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757dce1558354968862f47eae45129bc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.328501 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:44.340618 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757dce1558354968862f47eae45129bc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.341646 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757dce1558354968862f47eae45129bc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.354514 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757dce1558354968862f47eae45129bc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.356199 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757dce1558354968862f47eae45129bc'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.377720 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1471/2908] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:44 2022] DELETE /identity/v3/users/757dce1558354968862f47eae45129bc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:49:44.564421 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf299723-44b4-4da3-bab6-871505e7bed6 service swift] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:44.578251 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf299723-44b4-4da3-bab6-871505e7bed6 service swift] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:44.646244 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:44.646884 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:44.647212 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:44.647489 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] PATH_INFO: `/v3/projects/4290053e1f7840adac942bb5ba4c9173` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:44.648672 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4290053e1f7840adac942bb5ba4c9173)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:44.650600 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:44.699076 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4290053e1f7840adac942bb5ba4c9173', 'request_id': 'req-caa3e61d-4bb2-40b5-952c-e08c0b895d26'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.706747 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4290053e1f7840adac942bb5ba4c9173', 'request_id': 'req-caa3e61d-4bb2-40b5-952c-e08c0b895d26'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.712768 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4290053e1f7840adac942bb5ba4c9173', 'request_id': 'req-caa3e61d-4bb2-40b5-952c-e08c0b895d26'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.713885 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:44.727303 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] The token cache is being invalidate because project 4290053e1f7840adac942bb5ba4c9173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:44.727595 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.728264 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.729764 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1438/2909] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:44 2022] DELETE /identity/v3/projects/4290053e1f7840adac942bb5ba4c9173 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:44.734522 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:44.735940 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:44.749051 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a769-7a2e-48ab-8f84-b28d9b0bbe72 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:44.819612 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:44.820270 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:44.820527 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:44.820799 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] PATH_INFO: `/v3/users/1a120339c38a4980b78cf462e77045ed` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:44.821938 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a120339c38a4980b78cf462e77045ed)` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:44.823862 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:44.870599 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a120339c38a4980b78cf462e77045ed'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.883129 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a120339c38a4980b78cf462e77045ed'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.883866 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a120339c38a4980b78cf462e77045ed'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.891437 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a120339c38a4980b78cf462e77045ed'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.892092 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.notifications [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a120339c38a4980b78cf462e77045ed'} {{(pid=81766) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:44.905061 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1472/2910] 10.222.0.89 () {58 vars in 1224 bytes} [Fri Aug 26 15:49:44 2022] DELETE /identity/v3/users/1a120339c38a4980b78cf462e77045ed => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 15:49:45.100921 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] Authenticating user token {{(pid=81767) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:49:45.102373 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.fernet_utils [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81767) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:49:45.118391 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3e61d-4bb2-40b5-952c-e08c0b895d26 admin admin] Validating token access rules against request {{(pid=81767) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:49:45.174465 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0674a0b804427ca12cbbcd5e4a20f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f82c5c1108704750815ed9407c515587', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81767) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:49:45.175135 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:49:45.175418 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:49:45.175695 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] PATH_INFO: `/v3/projects/07a19f5ece914e55af30a25ce0812b33` {{(pid=81767) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:49:45.176845 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a19f5ece914e55af30a25ce0812b33)` {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:49:45.178752 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] RBAC: Authorization granted {{(pid=81767) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:49:45.226386 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a19f5ece914e55af30a25ce0812b33', 'request_id': 'req-a2ef3b77-ef35-4054-9527-d23e609bfd71'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:45.234061 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a19f5ece914e55af30a25ce0812b33', 'request_id': 'req-a2ef3b77-ef35-4054-9527-d23e609bfd71'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:45.239829 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a19f5ece914e55af30a25ce0812b33', 'request_id': 'req-a2ef3b77-ef35-4054-9527-d23e609bfd71'} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:45.251117 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] The token cache is being invalidate because project 07a19f5ece914e55af30a25ce0812b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81767) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 15:49:45.251406 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:45.252059 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG keystone.notifications [None req-a2ef3b77-ef35-4054-9527-d23e609bfd71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81767) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 15:49:45.253564 dv-cinder-831247-24-smb devstack@keystone.service[81767]: [pid: 81767|app: 0|req: 1439/2911] 10.222.0.89 () {58 vars in 1233 bytes} [Fri Aug 26 15:49:45 2022] DELETE /identity/v3/projects/07a19f5ece914e55af30a25ce0812b33 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 15:49:54.901086 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:49:55.248054 dv-cinder-831247-24-smb devstack@keystone.service[81767]: DEBUG dbcounter [-] [81767] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 15:54:15.778453 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] Authenticating user token {{(pid=81766) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 15:54:15.780065 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:54:15.894331 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786babf3-55e0-4715-a8f6-364d585fbc14 admin admin] Validating token access rules against request {{(pid=81766) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 15:54:15.981150 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e865b4-5974-486b-8c7f-ac8c2688d265 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d086e815c1542d1ba9daf81e644166a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57ff5577f8714f15af43ae67819220b2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81766) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 15:54:15.982146 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e865b4-5974-486b-8c7f-ac8c2688d265 service placement] REQUEST_METHOD: `GET` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 15:54:15.982478 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e865b4-5974-486b-8c7f-ac8c2688d265 service placement] SCRIPT_NAME: `/identity` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 15:54:15.982888 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e865b4-5974-486b-8c7f-ac8c2688d265 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81766) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 15:54:15.985191 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.fernet_utils [None req-16e865b4-5974-486b-8c7f-ac8c2688d265 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81766) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 15:54:15.999635 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e865b4-5974-486b-8c7f-ac8c2688d265 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 15:54:16.001475 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e865b4-5974-486b-8c7f-ac8c2688d265 service placement] RBAC: Authorization granted {{(pid=81766) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 15:54:16.014294 dv-cinder-831247-24-smb devstack@keystone.service[81766]: [pid: 81766|app: 0|req: 1473/2912] 10.222.0.89 () {60 vars in 1365 bytes} [Fri Aug 26 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 15:54:26.009071 dv-cinder-831247-24-smb devstack@keystone.service[81766]: DEBUG dbcounter [-] [81766] Writing DB stats keystone:SELECT=58 {{(pid=81766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}